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TJie ccntr*l thesis of this repent is that human Janguage La HP-complete. That is., 
the process of comprehending and producing utterances is Winded abow Iny the 
class y-p, and below by rfP-hwdness. Tha construe tive ecjflpJedtj thesis has two 
empiikaUoHseqiirnceB. The first is to predict that a linguistic theory outside JifP 
is unnaturally powerful. The second is to predict that a. linguistic theory easier 
than NP-batd is descriptively inadequate 

To prove the Wr bound, I tbow that the fdWmg three aubproblcma of language 
comprehension are dl NP-hard: decide whether a giwn nund is possible toad of 
a given Language; disambiguate a sequence d words; and eo/nbute the antecedents 
afpronounB. The preofii are baaed nhrectJy c* the empirical fatls of the language 
user'* knowledge, u Aq y f an appropriate idealization. Therefore, they are invariant 
acicas linguistic theories, f 1-- r this reason . no knowLedgc of linguistic, theory is 
needed to understand the proofs, only luiowiedg* of English.) 

Tn illustrate the weft fa ess of the upper bemad, I show that two widely-accepted 
analyse* of the language user's Icanwkdge (at syntactic: ellipsis and phoitplagkal 
dependents* ) ] C ad to ccnitpjrjdty outsJde of JfP (PSPACE-hard and UndecLdable 
respectively). Next, guided by the complexity proofs, I construct alternate linguistic' 
analyse* that are strictly supeiini on descriptive E^uriiLs ,« w«|] a* bring Less 
CCCtlpLex rnmputatbinajl>- {in jV'P). 

The report also presents a new framework for linguistic theorizing, that resolves iar 
portant pasties. Lit generative linguistics, and guides the mathematical instigation 
nt human language, 



A rJcncivirlodgCinonts: 

My grrjn.«,t dr'bl. is tn my tr-acher*, to whom this report Lb dedicated; to Robert 
C- Reiwiei, who gni me started In this work... carefully if ad long dTifts on shr^rt 
notice, and shepnrdtd rcii through. MIT Into the faculty job of my choice^ to Noam 
Chomsky, who awakened me- to the ruthless pursuit of Tiitana] thought and. mn^ij- 
icaJ truth, « - as always wiling to aigue with me. and ha* aiBg,le^haj^d-edtji" dragged 
the study of thought and power trat of the *lo*#i of idiocy which appears to be ita 
naturn] resting pl-ace-i to John Gncke, who ww my fiisi mentor; to Mgtjj'e Halle, 
who taught me dl \hr. phvmAc\%y 1 knew, including remedial sessions at no extra 
coat, arid always tried to understand what I couldn't always expires; and -,o Jorma 
Rissanan, who graciously taught me the philosophy and practice of statistical mod- 
elling with the minimum description length principle, alt in one summer, 

Tlin Ideas nf the report exist only due to the help and intellectual company of 
Sandiway Fong. James Higginhotharn, Huward Laanii, and Alec hlarantz. 

A special thank you to my thesis readers Fet*r Ettas and Michael Sipser for their 
help; to Erie Giinusoii Iot being a peerless academic advisor;, and to Patrick Winston 
far clarifying, my points and helping m* out in limes nf distress. 

Stephen Andciaon. Vivlane Depress. Ken Elate, El ilia Eioopman. and Feter S«ll* 
have shared their invaluable knowledge of the world "t pronominal systems with me. 

For their assistance, thanks to: Ear*. Blank. Pirnxhia Caurl, Faith Frl-ck, Alessandra 
GLoTg], Marla-Tlmresa GuaatL, Ron Gretnberg. Ray Hiracbfeld, Norhert Hdrnslein, 
Dave Kiish, Richard Larson, Tomas Loaano- Peres , Scott Meredith, Albeit Meyer, 
Geoff Pullum., Tanya Reinhart, Sally Richtei, Giorgjo Salt a, Barry Schein, Deb 

Surh.ii:. I l.:;i: I ;li, r:-.n i.-lli-r i V\t-i> el. Ai iiv ViV;n\:-Tp; an:i Ken IVesler 

The author has been supported by a generous four year graduate fellowa hen from the 
IBM Corporation, for which he is -extremely grateful. This report describes research 
done in part ai the Artificial Intelligence Laboramr y of the Massachusetts Institute 

of Technology. Euppuri. f:.T lIlh [.abcunlnry's artificial intelligence ikmi^jcIi ha* teen 

piovided m part by a ^rtuiL from the Kapni Fajnil_y Fuundation, in part by NSF 
Grant DCR-£!J552!H3 under a Pt-eaideutial Young En^a-li^atur Award Lo Prnfrssor 
Robert C Berwick, and in part by the Advanced Research Fiojscta Agency nf the 
Department of Defense under Office of -Varal Research ccmtiaet ND00M-.$5'-K-0m. 

This report is aahghlly revised version of a thesis submitted In the MIT Department 
C-1 Electrical Engineerii . a:id ■""-., ni| ■.:' it S;::--i:t .:i Vay 1990 in partial fr.'Ti! - -.-i: 
of the requirements for the degree of Due tor nf Philosophy. The major additions 
are a new lower-bound proof for the anaphora problem In section 4.1, and the 
philosphical diacusninq of appendix A i 

(^Massachusetts Institute nf Technology, 1990 



Preface; Mathematical Analysis 
in the Natural Sciences 



The purpose of this report K to elucidate the structure of human language, in 
terms- of the mathematics of computation and information, Its central thesis 
is that human language,, the process of constructing structural descriptions, 
is NP-COmplete. The body of the report js devoted to defending this point. 

Any such mathematical investigation of what is fundamentally a topic in 
the natural sciences muEt be both, relevant and rigorous-. It must simulta- 
neously satisfy the s«mingly Incompatible standards of mathematical rigor 
and empirical adequacy. Of the two Criteria,, relevance is the more impor- 
tant, and judging ny historical example, also the more difficalt to satisfy, 
If an investigation is noL rigorous, it may he called into question and the 
author perhaps asked to account for its lack of rigor; hut if it is not relevant, 
it will be ignored entirely, properly dismissed a* inappropriate mathematics. 

In Ordar to ensure relevance, such an investigation must demonstrate a com- 
prehensive understand Ing of the natural science {linguistics, in this case) 
and provide two warrants.. 

The Just warrant is a conceptual framework for the investigation, so that 
the mathematics is. dead to answer relevant questions, The framework must 
include a technique for performing the analysis in the domain of the chosen 
natural science. This technique must ensure that the insights of the science 
*r* preserved, and must be sufficiently general SO that others can extend the 
Investigation. 

The second warrant is a contribution to the natural science itself. Such a 
contribution might ;ake the form of a simply-stated mathematical thesis tha-t 
is an independent guide to scientific investigation in the chosen domain. To 
be useful, this thesjs must make strong predictions that are easily falsified in 
principle, hut repeatedly confirmed ill practice. Only under these conditions 
is it possible to develop confidence in such a thesis. 

An exemplary mathematical investigation into human language may he 
found in the work of Noam Chomsky. In Torre Modeh /er tfte Descrip- 
tion of Languor, ChomsLy (195(f) defined a framework within which to 
examine the empirical adequacy of formal grammars. He posed the follow- 



ing questions: Do human languages require linguistic descriptions that are 
outside the fBrfig* of possible descriptions? Can reasonably Simple grammars 
be constructed for ail human Languages- Are- euch grammars revealing, til 
that they support semantic analysis ar.d piov]d<: insights into the use and 
understanding of language? This Is the first warrant, 

The article also provided the second warrant, in the form of & simply • staged 
complexity thesis, namely that human language has a finite -hut no finite- 
State — characterization, and that the simplest and most revealing charac* 
leriiiation Is given by a class uf unrestricted rewriting Hystems, The es- 
say demonstrates an unqualified commitment to understating human Ean- 
guage. Sm, by way of contrast, Curry (19r>I), Lambek (1&6T), Peters and 
Ritchie (1073), and Plitek and Sgall (1979). 

In this report, I argue that language Is the proccsw of constructing linguistic 
representations- from extia-iLr.puJstlc evidence, and that this pftjcnss Is NP 
complete. This brings Chomsky's 1956 complexity thesis up-to-date, with 
The advantages of a better understanding of language (the result of thirty 
years of productive research in linguistics) and a mora precise theory of 
structural complexity, based on computational resources rather than on the 
format of grammar? or automata. The resulting thesis is also much stronger, 
providing tight upper and lower bounds^ and therefore is a truly wnalmciiue 
complexity thesis for human language. 

The complexity thesis is defended with a novel technique, called the direct 
analysis, that may be contrasted to prior analyses, whif.li have all h^u in- 
direct. An indirect artfifyais is an analysis of a formal system within which 
linguistic knowledge may he represented, a hind of programming language 
for natural language processing. Indirect proofs are based on the ad-hoc 
particulars of the formal system, and only very tenuously (if at all) on em- 
pirical facts. Indirect analyses of human Language may be found in Peters 
and Ritchie (1973) and Barton, Berwick and Ristad {3987). In contrast, a 
dirtct analysis is a mathematical analysis of linguistic knowledge itself. In it, 
proofs are hased directly on the empirical facts of linguistic knowledge, and 
therefore are invariant with respect to our scientific, ignorance. To the best 
of my knowledge, this report contains the first direct tcxuplcxity analyses of 
human language,, which provides the first warrant. 

The complcsdty thesis makes strong prediction S h because many proposed 
linguistic theories vjojate it, and h^cause the A" P lower hound is in sharp 
contrast no che prevailing belief that language Is efficient, which is held by 
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raajiy linguists psycholinguists, and computationa] linguists, la the body of 
the report, 1 pryv^ the lowei hound m three distinct domains, using direct 
complexity analyses. I demonstrate the utility of the AfV tipper bound by 
using it to guide the revision of the segmental theory of phonology, and 
of the copy-mid-link theory of ayntactk ellipsis. This provides the second 
waiiant- 
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Chapter 1 

Foundation of the 
Investigation 



The chief goal in the computational study of human language is to design 
a computational model of the language user, that explains the processes of 
comprehending, producing, and acquiring languages. The central obstacle 
that we encounter in such an investigation, and in engineering systems for 
language ptrcept:on. : : - rn:r incomplete scientific understanding. In Order to 
overcome this charade, we need an independent a priori' criterion to guide 
the design of oar language models and the revision of our lingnjatle theories. 

The goal of this report is to characterize ihe complexity of human language, 
using only empirical facts of linguistic knowledge, Such a complexity thesis, 
with tight upper and lower honndsi, yields a useful design criterion. It ob- 
jectively measures the significance of a particular design decision, in terms 
of Hi effect on the complexity of the language model. It tolls us when a 
language model \s too restrictive: Language models that do noc satiny the 
lower hound do not have an adequate account of complex linguistic phe- 
nomena. Any particular design decJStOfl Or empirical generalisation may of 
coarse violate the lower hound, which Ls relevant only to the model in its 
entirety. A complexity thesis also tells us what is a reasonable empirical gen- 
eralization: that in the absence of overwhelming COunteievidftn.ee. empirical 
generalEz-ltionE must conform to the upper bound. 

This introduction establishes the foundation of the research, on which a 
constructive complex iry thesis for human language is built. According to 



the guidelines set forth in (he preface, the chapter must accomplish three 
things; first, provide * conceptual framework, that poses relevant questions 
for mathematical analyses; second, introduce arid motivate the central thesis 
of the report, that human Language is NP-complele; and third, discuss the 
formal technique of a direct complexity analysis, that will preserve the in- 
sights of linguistics in the details of the complexity analysis. Let us consider 
e&eh in tarn. 



1.1 The conceptual framework 

WJljli is language" Au.:rc:i-.;^ to generative linguistics, language is a cog- 
nitive system of knowledge. The generative grammar of a particular hu- 
man language enumerates aj] and only the possible (complete, grammatical] 
Structural descriptions of that language. These structural descriptions are 
acquired on the basis of experience, and put to use in the production and 
eompreheMion of expiessioas. 

An important component of linguistic knowledge 19 JfnowEedge of Linguistic 
dependencies, that is, how the parts of a linguistic form depend on each 
other. For example, speakers of English know that the subject anri main wrh 
of th« m at ri x riau Re agree wj Lli each ot hen knowing that the su bject is plural 
predicts that the malll verbis also marked plural, even though this marking 
may hot be overt. Speakers of some English dialects also know that voiced 
consonants are immediately preceded by long vowels; that /t/ and /d/ are 
both pronounced a* the voiced flap [D] After a- stressed vowel, if another vowel 
follows; and that this voicinc depends on the vowel lengthening process, 
Th» knowledge of phonological dependencies explains why paiis of words 
Lie d-rtfer, rider and latter,ladder, are diBtinguisbed phonetically only hy the 
length of their nrs.*. vowel, while related paiis such as wrilc,ride maintain the 
underlying voicing distinction between /t/ and /d/. From an information- 
theoretic perspective, then, a generative grammar provides a constructive 
characterization of the Informational dependencies in the surface forms (ie,, 
the expressions) of a particular language. 

The generati W framework poses a number of conceptual puzzle that must 
be resolved in order to understand what language is, 

• The first puzzle is the relation between production and comprshtDiluLr 
Why people can learn to comprehend and speak the same language? 

3 



And why can a sound mean the same thing to the person who spoke 
tt and the person who heatd it? Generative linguistic- theory postu- 
lates that these two abilities,, production and comprehension, shnie 
one component: knowledge of 1 anguage. But why should Broca's and 
Wernicke's Areas,, the two distinct regions of the brain that seem to 
perform these t?j.k^ L have the sams iricwledge of language? And ho 1 * 
can one 'knowledge component 1 Solve the entirely different problems 
encountered in production and comprehension? In electronic commu- 
nication systems, the transmitter and receiver rarely ever share hard- 
ware because they perform s-uch entirely different functions. They 
interact, successfully only because the human designer intended Ihem 
to. 

* A related puzzle is to explain comprehension independent of preduc- 
tion + and vice- versa. That is,, how can we explain what it means to 
comprehend an utterance -without direct access lo the intentions of 
the producer? To comprehend an utterance cannot mean to find the 
exact structural description, in the producer^ head, because that is 
never available. It cannot mean to find tfOrtte structural description of 
the utterance! because this allows, the null structural description as a 
trivial (noajsclution. Not can it mean to find ail possible structural 
descriptions for the utterance, because this does not tell us which one 
:s the Intended" structural description. 

• A third puzzle is how language can he at once so complex and yet easy 
lo use. Consider the sentence [BiH expected to s«z htm]. The pronoun 
Mm cannot refer to Bill. But as a part of another sentence, f vumdcr 
ieAo [Bill expected to we him], it can. Linguistics tells hh that complex 
systems arc needed to describe this kind of complex, phenomena. Com- 
puter science le)|s us that complex system* do not perform effortlessly. 
Yet tanguap processing seems to be efficient. How can this be? This: 
is Cardemoj^s paradox, named after the C&rtesian linguist Geraud de 
Cordemoy who observed, "We can scarce believe, seeing the facility 
there is in Spcabr.g, that there should need so many parts to be acted 
for that purpose: But we must accustom ourselves by admiring the 
Structure of Our Body, to consider that 'tis made by an incomparable 
workman, who is inimitable. 1 ' (1667, pp.84-5) 

■ The fourth puzzle is iiow is linguistic knowledge used in actual perfor- 
mance. People produce, comprehend, and acquire languages, These 



are the empirical phenomena in need of scientific explanation. Gen- 
erative linguistics attempts to explain these phenomena by postulat- 
ing theories of linguistic knowledge. But Low is this knowledge used? 
What is the exact relation between a theory of knowledge and a model 
of the language user? Lacking an answer to til* central scientific ques- 
tion,, Ike theory Is at best incomplete; at worst, it is incoherent- 

These puzzles are best resolved by the conceptual framework, within which 
particular theories are to he proposed. A framework does not jtself answer 
empirical questions . Rather, it explains hnw thesA questions will he answered 
by particular theories. 

The conceptual framework of this mathcrnalicftl investigation is- may be sum- 
marized as follows, The language faculty is a mental organ, that performs 
a computation, which we may call "language. 1 ' Language is the process oi 
r (-instructing representations from evidence. The central questions that arise 
in such an approach to language are: what is evidence, what are represen- 
tations, and what is the relation between representation and evident*? 1 
adopt an information-theoretic: perspective on these issues. 

Briefly,, the language faculty lies at the interface of several cognitive sys- 
tems, including the mental leicicon and motor, perceptual,, ami crtncwpmal 
systems.. The forms continually produced by these cognitive systems arc the 
instantaneous evidence that the language, faculty sees. Language, then, h 
the process of computing the informational dependencies among the codes 
continually produced by these cognitive systems- A generative grammar is 
an enumerate ve code for this instantaneous evidence, Linguistic representa- 
tion* arc representations of these dependencies, and the structural descrip- 
tion constructed by the lausmage faculty at a particular instant in time is 
the one that most reduces the apparent information iu Lhc instantaneous 
evidence, thai is, the best description of the evidence. An overs expression, 
whether spoken or written, constitutes only a very small part of the total 
instantaneous, evidence available to the language faculty. The more addi- 
tional evidence that the language faculty has at til ft moment of perception, 
the more complete the structural description of that evidence will be, and 
the less random the utterance appears to the language faculty, 

This constructive (as opposed to generative) explication of what language is 
explains how the preceding puzzles are to be solved; 

• Production and comprehension are the same process of representation 



COttStractioTS. The cfltltral difference between the two \i in the direction 
of data dependencies, and kll the distribution of the instantaneous 
evidien.ce. For example, in production the percept ual ivjflem. provides 
less evidence, while in comprehension, it provides more. 1 

■ It defines cnrn prehension without reference to the producer's inten< 
Lions, IjOclluks comprehension arid production always compute the best 
description, of the availabh] evidence. When there is Sufficient evidence 
avaiJable (from the cognitive cnodd of the speakers, intentions, the 
perceptual system, and. the priming of lexical eiLtijre. for example), 
then the comprchender constructs the same representation, that the 
producer intended. 

» A linguistic representation is the hest description of the available evi- 
dence. The best description of iflCOttipkle or insufficient evidftn.Ce is an 
incomplete representation. Therefore!, the language faculty need never 
perform a blind search that can lead to computational i sit rM lability, 
The language Jaruky dues not assign a complete representation to in- 
complete evident*, even though some complete representation might 
he con-sisKtent with the evidence. 3 

• The Constructive framework also suggests- a wai 1 to understand the 
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■Th.ii frimt^uric IneTEfiHE aclinic mo* Cartenaa lEparation taluwen. Lhe pro:™* q-f 
CunslTuclLng meata] hpkbcbCaIjdiu, and tht (HSttepfu at evidence th*t ju-s-llfles a par- 
tSCifllat mental nrpracnUtfeH . NolE, faowewar, th*l til* tnaewmi fail.? I* provide anv 
(LBdn&titodiiig Dr tb.fi CMitivp *=pcct* of production Lh«l «n CDntErned. C*rt«flj*BH. 

On thie view. laaguagG cmum Lhe EDrnpuEiiincjal module thai Frtdai (IU83) atgiiEi 
it if, tocsiMH il d not irvformauoiially ejicap*ulat«j. Cont« Fodor, tfcb »' *d*nttJkally 
dejarahje t«;auae iL is the enlv W4» to explain how l&D.gulgE com pre he nai cm jS pnwLble 
*l ili La the face *f «:Li perceptual u mt*rde(*nninat»Dii. [f thrf ofltj input to lae^uare 
C0nipieb.ED5ion wk SEiiBalioir, dt Even an ttoir&rt noue Tree expiwsLoa, cLeu Lfae rrpbl«l 
of fiAintrncliiig anything bee the Lntcn<J«4 itJUeueat-atiDc mnrnti Vo il-pond b a wri- 
^ii? ^-,y (Tin j-h.n-.t- I:, [rue lur s Haleirecnl M di? UaguagE production Dmaleni whciw 
sol* input ^vaa a reprewn.ta.taDn n>[ -irjeaniriif.) As in well-known, a system coaHiting oi 
campiiLiHoiiaJ modules ie nwesoanl* iDEfiLcLcat . both tempulatLanally «,j tdCuticaJiy. 
(Restriction \bt amount cl" information available to a module, foulta is a computulientL 
iaErJIcieacy bpeiupe tbal module in tnMt (o prune btaaebe* in jCh cosnpotatiem tie* as 
EiHy as il might otherwise be able t,j, It results in a KtiUKtJci] inefficiency nwftUM a 
module raLgJit need to rtinunr all avaitablc tvijence in aid.Er to dft^tmine t:-.i Dpi..-,,*] 
Mitinnii*, c£. Wan ami Kaitath. 1935.1 The foneitbtUTe IrajDewarb snRgpsm .in. an»wi;r to 
Cond^mov's parafm, namdy, tanjoage Ls the prorow o[ *fTidrnll>- canfitTSCtiiiij Lbe beat 
dra-ciLptiani aJ aTIlIk avaiianfc evidane*. In islioit. (-hE only raektuLw in buman langatge 
are »tatrart knowkdgf tlwUirlM, r«M CDmpitiati^iiil mcdulea of any kind. 



relationship between genera'. :v« thuory and a computational model of 
the language useTr A generative grammar is a construct] vf theory of 
the informational dependencies in the extra-linguistic mental codes, 
At such, it enumerates the set ai complete structural description*, 
and thereby provides a paiLial, ex'lcnsional chaiatteTiaation of the re- 
lition between extra* linguistic codes and their structural description*: 
^extensional* because a generative grammar Only describes the set of 
possible output*, and "parciaT because this set is limited ty complete 
structural descriptions of complete, noise-free expressions. For these 
reasons, a generative tru*ory is a necessary first step in the design of 
an adequate constructive theory of human language. 

However, the theory of grammar doe* not specify the function, to be 
Computed by the language model. For one, the input to Ehe two com- 
putations is not the same, The Input to the language model is the 
set of codes produced by the other cognitive systems; the input to a 
generative grammar is an underlying form., which is the index of enu- 
meration- Not art the possible outputs of the two computations the 
same. The Language model assigns a structural description to every 
input, and therefore the set of possible outputs must include partial 
descriptions, for inconclusive evidence; the generative grammar only 
enumerates complete structural descriptions [cf. Jackobson and Halle, 
1056}. Grammar and language model also specify different relations 
between a structural description and the expression that is Its overt 
terming] string yield, The generative grammar specifies a relation 
between complete structural descriptions and complete* noise- free ex- 
pressions. The language model specifies a relation between structural 
descriptions and extraMnguj&tk evidence; the relation between struc- 
tural descriptions and their overt expressions is an almost inconsequen- 
tial subset of this relation, that also includes structural descriptions 
for incomplete or noisy expressions, 



''Jur there icawris. a ji-irsci cmnot br. i language made), ar even part at i lioguafln 
□LadeL. A Language mfldrl in a rn n-rttnn firm the iDxtiDiajieans cvidencn. whirii Inrcks 
nothing Like an abjLract s1r:n.g of tcirciina] srrnciab, to tb.c brsl itTuxCurat desrrijiiicici of 
thi-t rutden-Ct, A pacser ia- a. Enaction from a s-tiinj of lei-nulia! ftrmtob to (Jut net cJ rtnic- 
Liira.1 df.Mjripliojli *-tiL»e yield ediBusttf t!h*t a^mboJ-fltEillA- F<" ibis t«i«on U Lsf phuKJvk 
ta maintain thai H tT)t thwr}' of £ T bin ITlM,-,-&T>t elfins the funciwm Ea be cam pn ttd hy *-\i< 
F&EHI'*' ■! E *■[■»■ ick and. Weinberg, 198-i:BJl. However, II ia crd-del Lo icaJixe tJiai pairing 
has bhibivl nu retail-on Id lbs cc.rapieh.eciHC.n, prDuWlio*, At fetCLU.it) it km o( Jajigmgei, and 
thfPffnr* \s of Little et ju> fleiemLUc IjiteceBl. 



This is simply to sa-,j\ generative theory is not a model of human ]&ii- 
SuaRe, at any level of abstraction. Rather, it la a utOcfcl of linguistic 

AfaiTi, it t9 important to stress thskt this is a framework tor addiess.is)g scien- 
tific questions and performing TOatherciaUcaL analysis, not a scientific theory 
itself. The substantive answer* to these puzzles li(i in the next generation of 
constructive linguistic theories. 

However, for Our present purposes this coo struct ive Craanew&tJi {that lan- 
guage JS the process of const ructrng representations of MtraJinguisttc input? .) 
poses relevant questions for mat hemalical analysis. By equating compre^ 
lieniion and production in a fundamental manner, the framework sttys that 
the language comprehension problem is a proxy for language as a whole. 
Therefore, we are assured that the mathematical analysis of su.t>problems of 
language comprehension will be relevant to language as a whole. 

To view human language fmni an imformatioi^thoorelic perspective a* we 
lave done here is not to say that language is. designed for communication, or 
even that it's primary use is to communicate. Nor do we claim that Language 
is a general- purpose computer Of that language is designed for computation, 
wheu we analyze the computational structure of language. The goal of 
this research is to understand, human language ill its own terms; computer 
science and information theory provide useful technical metaphora. That is, 
important aspects of human language receive an insightful interpretation in 
terms of computation and information. 

H Thae points are subtle, ind hive ttjiilased minf peopl*. No Iris *. uri curds! thin 
Qivid Mair (19SC0 his {■oufuscd LJic cwiirm^Hce-pEiibTiiimf* dialLacEiDn, <rf jfrAeiatirc 
IJTl(ai3(JM with IctcLs of cOttiputaliDTiai aHwcj-tetism. Eful, js wt htrt ■een, Hi* Julatiaii- 
ship WL**™i craapewnw &nJ perform mcf it- nc-t ane of ahsi[*cti<ni. CamptteSirt and 
pafccum in Mmply <ntirely *L'ffereni. cJishs flf compulaiiajiii, txrth, at which may b 
itKribed *t diffcreat Icvrh tA ibMraclbn. Fm alginate iBceTPTCtfcsknis of the kUHdl 
between, generative S nrnmar and inirn.au Janfru*^, at odds with tin? dtlc praenlrrtl ]i*[f 
we Chomsky («»), Chomsky (19W), SUUtr (1983}, B«t*kk uid WeLnh- JE i ]PH1 ud 
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1«2 The constructive complexity thesis 

The centra] thesis of this work is that hum&flt language has the structure 
of an NF-complete problem , &,,fl An NP-complete problem is hard to solve 
because the input to the problem, is missing acme crucial information (the 
effkku" ■■• il:ii.-.v !• V-ii i:\t\r :!.-.■ <-ltic i ■' n t witness (the ■-*■■■! 1 1 ' f : : i ; i:- I'nur.d. \' ; : - 
easily verified to be toned t, As Stressed by the great nineteenth century LLjl- 
guj&t Wilhetm von Humboldt, every sound uttered as language is assigned a 
complete meaning Siid. Einguistk. representation in the mind of the producer, 7 
It is the ",a&k of comprehension to find the intended representation* given 
only the Utterance, When the utterance is missing crucial d i S&m bi git a.t i n g 
informition, and there are globed dependencies in the structural description, 
then the cask a: finding the intended representation quickly becomes very 
difficult- (In effect, we are able to prove the Lower bound, thlt language is 
NP-hard, because the amount of useful information in the evidence is not 
a parameter of current linguis-tic theories-: ail reduction* below take advan- 
tage of this fact 1 which became obvious only in retrospect.) Yet we know 
comprehension cannot be too difficult;, simply because there is always an 
efficient witness^ namely the linguistic representation from which the uttei- 



*TnL» e Dm ji Laxity th«i± \s eocsiriclivt because 5-h-e n^v-tc ini Lc»wfr bounds JtTC lijfjit 
EBongh to tell os r.iw.lly where ihn a.neqnate Li.ac.mstn: laeujiiri Me, not only whflt* lliey 
he noi. Here "cDTiitrnctive" menu '■useful..* H h in. central In Chtymnky 7 * l9(Vfi ccrn- 
pLeriiy thai*, wbLch is nai is useful because — aa *jfcued in Ch-tolk&lsy fjfl>851 — Lh« upper 
bound ia *ei* louac, ihe Ujwec buSlid is wfwt;.. A*d th^ formal Jan^nage ihcaiy- af Unic 
(■Ural complexity iu n*l B-uffieiendy v? ■<[*'■ Tli.- ™ncepL\:n.l framework presented. :n tbe 
f JMediQ^ flection js cttnutr.'uaive beC&UjSS it OUtlia-SS * made£ aff the language user, ikat 
■mould directly cbajacltcise due tara|^t*U*tlS preformed in tbe production, connprehen- 
jinn, and a^uismon of liuiciih iriiiftii&p/s. Thflra "omit met Lvc h means "given explidlJv, 

'::;. rrai " r ii :■' .. ii . ' "■ i,- i:.i.-i ' : ['-., ^(■■n^r.i.cLv.f- rTinei^arJt, which prafidet- \i paj-.iil. 

eilenuDnai chrirAOf Tir-a/tirm ai nirHiurtian, CDmpTebennLcm, and ncqaiyitjun. 

4 Aa tlijujd be clear [com the chrcusHun, NP-ccjmfJllhW » not i.rve *ti£m* tliM m*BJ' 
ippaictiily ibtijiL ji b. [n [*ei. eiacLtj- die oppoail* is tru/;. The- tM&ib nrguca that more 
effl-citnt Injigtiaje models arc [nndanien(*l]v inude-yUlile, h-wring. ai r.nu.t*c a ifv^iMinn >n 
our understanding *I languid oc of uonJcterrainism.. 

'"The s^iface ia ni>t U> be -COii-fLriKtwt,. ie Tint to h* ^r^dLiaJLy built up of cumpunnrilt, 
but is Lc be exp:esHwl all ,\t an.ee in a form coon preased to iiaLlv. .. Mio Law aid I j rela(*n- a 
comulete nearsLnc ivitb Every soucd emltled aj LajiRT]ice ■ [Lat it, tttl hicu i( n> n rOlo^eie 
cUbijiii'.™. Man. goes act :n(eatLDnaJlv eoij( meceEy an ii«>(rf.lei1 wofd, IfH thOM|h liiv 
etatemen: accor-Hiiig to niui viewpoint miy only CDnlaio mcb. an eaLltj.' (von. Humbcildl. 
I SJS:1 ID— 111) (The upper bound of Cb.DinEkr'= 1955 iiUniikxity tliMii, (liht lirv^nsjiie li4e 
a Anitv dmciLpLioa, aba appeacs to be mativaieJ bj an obe^fvatjon. d IW? to von Huniboldt, 
{.hitUngiik^c \i ib e "jaflalte uau of finite m«B6") 
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ance was produced. If only the comprehends? hBUi the same evidence that 
lie producer did, then lie would be able to efficiently compute the intended 
structural description^ because tie producer did. 

The central empirical consequence of this thesis is that sci etlti flcaUy adequate 
language models must hv jVP- complete, under appropriate Idealizations (see 
appendix A. 2). U a linguistic system It outside tfT, say PSPACE-hard, 
then the thesis predicts that the system JS UMLitu rally powerful, perhaps 
because it oveigenerahzes from the empirical evidence or mjsanalyaes some 
linguistic phenomen a. S«eh a system most be capable of describing Un- 
natural languages. If, however, a complete system is. easier than MP-hard, 
and assuming V £ tfP, then the system is predicted to be unnaturally 
weak, most Likely because it does nor. adequately account for some com 
plex linguistic phenomena. Such a system will not be able to describe all 
human languages. Otherwise the system is NP-complete and Is potentially 
adequate, pending the outcome of more exacting tests, of scientific adequacy. 

The thesis is weakened if any of the formal arguments presented in this- 
dissertation are refuted- It is falsified if either of its centra] predictions is 
falsified. That is, Someone must exhibit a comprehensive theory- of human 
language and prove it to not have the structure of an NP-oomplele problem, 
or someone must ?x3u.bil sora« complin lingua tic phenomena and argue that 
its complexity b outside A'"P- 

This complexity thesis, then, is an independent guide to the study of lan- 
guage. It is useful because it is & simple decision procedure with which 
to evaluate linguistic systems, both theoretical and and implemented- The 
student of language will find it helpful, because, as this dissertation demon- 
strates, linguistic analyses that hive complexity outside of MV aje ripe for 
reanajysis. 



1*3 Direct complexity analysis 

The logical next step is to establish this N P-campk'teness thesis. The central 
technical obstacle encountered in this work, and in all research on language, 
is the incomplete- nature of our scientific underst anting of language. For this 
reason, it is not clear how to precisely define any computational problem re- 
lated to human language at all. Our understanding of human language [ a 
neither comprehensive, detailed, nor stable. Any forma] model of language, 
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obtained perhaps by formalizing some particular linguistic theory, will be 
based as much oil OUT scientific ignorance as on our understan ding. Con- 
sequently, no meaningful or Comprehensive formaliaa-tiou is possible, and 
any mathematical analysis of such a formal system would have- little ur no 
relevance to Language itself. 

To overcome this difficulty. We must seek Ml analysis that 1* invariant with 
respect to out ignorance. That way., future work may enrich our analyse., 
but no* falsify it. We niay accomplish tbia objective with 4 direct analysis. 

A direct analysis is a. mathematical analysis that relies directly Oil well- 
understood empirical arguments about the language user 1 * knowledge of 
language in order to prove mathematical properties of that knowledge. It 
does not rely on a complete formal model, In a direct analysis, we use 
the scientific methods of Linguistics to construct the simplest theory of a. 
natural, well-understood class of linguistic knowledge, and then analyze the 
properties of this knowledge. We perform such direct analyses in section 2.2 
for the language: user's knowledge of supraseppnental phonological depen- 
dencies, and in chapter 4 for knowledge of referential dependencies. Slightly 
less direct analyses may be found in section. 2.1 and chapter J. 

Prior tti at hem at ical analyses of language have all been highly indirect, prov- 
ing properties of formal systems within which theories of linguistic knowl- 
edge may be represented, This is like analyzing the properties of FORTH; AN 
in order to better understand QUICKSORT. 

A related difficulty is that it is not known how to define language compre- 
hension (LC) without reference to the producer's, intentions. As mentioned 
above, the real solution to this difficulty must he provided by the nest gener- 
ation o: linguistic theories. The temporary solution adopted here is to select 
sub problems of LC that may he defined independent of the producer's inten- 
tions, and arc necessary subproblems of any reasonable constructive theory 
of comprehension. (Given the ^reasonableness* equivocation in the second 
clause, it Is admittedly more a matter of art than science to define such 
sub problems.} 



1*4 Summary nfthc report 

The technical content of the report is apportioned into three chapters and 
two appendices; 
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Chapter "5 examines the computational structure of phonological dependen- 
cies. It begins by establishing tlL« undecldability of both generation and 
recognition problems for the segmental model of phonology, Guided by the 
complexity analysis, we propose a broad range of substantive restrictions, 
that result in a more natural segmental model whose generation and recog- 
nition. pj^Mems are both in .MP. ^e*t, a direct analysis is provided for the 
complexity of suprasegHiental dependencies. The chapter closes by reveal- 
ing tbe indispensable role of a complexity thesis in the design of a theory of 
tinman knowledge, to Ruard again st gross OVtigenerahzations. 

Chapter 3 examines the LC problem in the domain of morphology and syn- 
tax- We- demonstrate the art of choosing; a snhproblem of languapje compie- 
hemsion tha-t j* relevant despite our inability to define the LC problem itself, 
and prove the chosen snhproblem to be NP-bard. The chapter concludes 
with a critique of the pursuit of uniform mechanisms in huguistic theory. 

Chapter 4 provides- a direct analysi s of the anaphora problem, which is to de- 
termine the intended antecedents of anaphoric elements in a discourse. Kirs l 
we prove In two entirely different ways that this LC snbproblem is NF-bard, 
based on empirical facts of tk- language user's knowledge of pronominal 
reference,, such, aa why John saw him cannot mc-aoi 'John s-aw John'. Next, 
we show how a widely-accepted linguistic theory of syntactic dlipsja makes 
the anaphora problem Pd PACE- hard, Finally, guided by the complexity 
thesis,, we falsify this linguistic theory And sketch an empiric-ally superior 
theory of ellipsis tha: iMi^es 1h'j comp:e3dty of anaphora to inside A r V, 
lh<- conclusion; to this chapter critiques an alternate approach to the math- 
ematical investigation of language, based on the complexity analysis of the 
computational problems posed by Linguist]*: theories. 

Appendbt A discusses two philosophical issues relevant to the research re- 
ported lieie. First w c discuss the implications of complexity classifications 
for biological computations, and untangle the distiuction between compe- 
tence and performance, Nest we examine the de facto idealisations to un- 
bounded inputs and unbounded linguistic distinctions , that have lean made 
implicitly in every serious theory of human language, as they must ajwavjs 
bi. 

Appendix B provides another warrant demanded in the preface, that tbe 
Work make a contribution to the natural science itself. The contribution Is 
an improved generative theory of syntactic ellipsis, with a discussion of a 
hitherto unnoticed phenomenon of invisible obviation, with important im- 
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plication Ibf tile ths&ry of anaphora. This, appendix le an tiukpfn dent, 
nooiHlfttheniatical coEtribuiidn to the fid d of UnguiEticB. 
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Chapter 2 

Structure of Phonological 
Knowledge 



The goal of this chapter is to elucidate the structure uf phonological knowl- 
edge, from tli<- yercpectives of computer Science and information theory. 

Linguistic sounds contain predictable information. 1-Vif example, English: 
speakers invariably aspira'-i; .;• voiceless siop jn th.C unset of syllable (a* il- 
lustrated by minimal pairs such as [k*ab;^[gabj and [p^atj^fbat]) bat only 
when tin.- onset iK n on branching (compare [p^it]-v|trrtt| and fjj^jt]^[skitj). 
The raised! l h" expresses aspiration, that i* h that the segment is pronounced 
with a slight puff of air. Moreover, vowels are lengthened before voiced 
consonants (contrast the articulations of wlr-enp> bap^back, and to forth). 

Because these and other phonological dependencies are a part of the lan- 
guage user*? unconscious knowledge, they muHt he represented in an ade- 
quate linguistic theory- In generative phonology, dependencies ill the surface 
forms are encoded, by a grammar of rewriting ruled. Using a dictionary of 
underlying forms. An up deriving form represents the true, unpredictable 
information content of a given surface form. It is constructed by combining 
(typically, wilh con eaten at ion Or substitution) segmental sequences stored 
In til* dictionary of morphemes. The grammar G derives a surface form \s] 
from its corresponding underlying form /u/ in the dictionaiy D by repeated 
application of rules to the intermediate; forms i'j t i 7> L . , of the derivation, as 
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shown in 2.1: 

Each rule represents a natural class of predictable phonological informa- 
tion. Continuing *'ith our example, the generative grammar of an English 
speaker must contain rules for aspiration Mid lengthening. The aspiration 
rule rewrites the underlying form j/kab/ as the intermediate farm /k^ab/,, 
adding the entirely predictable inspiration information to the voiceless stop t, 
Next, the lengthening rule applies, rc-wriiir.g the intermediate form y'k' J ab/ 
as the surface form [k*&:b], 

According to generative phonology, the logical problem of language tompre' 
hensiou consists of finding a structural description (that is., an underlying 
form and a. derivation chain) :"or a given surface form,- In effect, compre- 
hension is reduced to the problem of searching for the underlying form that 
generates a given surface form. When the Surface form does not transpar- 
ently identify its corresponding underlying form, when the spa^e of possible 
underlying forms- is large> or when the grammar is complex, then the logical 
problem of language comprehension can quickly become very difficult, 

The chapter is organised as follows. The next section introduces the segmen- 
tal model of phonology in some detail, discusses its computational complex- 
ity, and proves that even restricted segmental models arc extremely power- 
ful (undecidabk). Subsequently, we consider various proposed and plausible 
restrictions on the model, and conclude that plausibly restricted segmental 
models will be in Jtf"P. Section 2.2 introduces the modern autosejgniental 
(nonlinear) model and discusses its computational complexity. We prove 
tli at the natural problem of constructing an autosegmcnlai representation 
of an undersnecined surface form is NT-hard . 

The central contributions of this chapter ate: (i) to analyze the compu- 
tational complexity of generative phonological theory, as it has developed 
over the past thirty years, including segmental and autosegmental models; 
(Li) to suggest a range of restrictions on the segmental model that reduce 
the complexity of the corresponding language model from undeddable to 
inaida J\f"P; (iii) to resolve some apparent mysteries regarding the SFE eval- 
uation metric and the notion of a linguistically significant generalization; 
and (iv) to unify the description of suprasegmental processes as establishing 
the segmental domain within which one 'head 1 segment in the domain is 
phonetically distinguished from the nonhead segments in its domain. 
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2.1 Segmental phonology 

We lav* seen chat phonological knowledge includes a grammar of rewriting 
lilies, to derive turface. forms from underlying forms, The scientific questions 
that arise are h what is the class ol permissible rewriting rules, and him aje 
they applied in the derivation? 

To summarise, the rewriting rules of the segmental phonology are unre- 
stricted ami can manipulate morpho-syntactk constituent structure, Rules 
art ordered into a hLoek and interact with each other. In a derivation the 
blo-cl is repeatedly applied, from the innermost constituent Out, Let us 
eJtamine this sys&em jfi more detail. 3 

Phonological features arc abstract as compared with phonetic representa- 
tions, although both are given in terms of phonetic features. The Set of fea- 
tures includes both phonoEcgieal features, diacritics, and the distinguished 
feature s:eg=.ent that marks boundaries, Cu'acriLk features are associated 
with lexical items as a whole; they control the application of ttdea. An 
example diacritic is- ablaut, a feature that marks those stems that must 
undergo a change in vowel quality, such as, tense-conditioned ablaut in the 
English sinj p tang, sung alternation. As noted in SPE, "technically speak- 
ing, the number of diacritic features should be at leait as, large as the number 
of rules in the phonology. Hence, unless there is a bound oil the length of a 
phonology, the Set [of features] should be unlimited-*' 1 (fn.l, p3(]} Features 
miy be specified + or - or by an integral value 1,2, . . , , jV where N is the 
maxima] degree of differentiation permitted for any linguistic feature, The 
vine nf jV varies from language to language, because languages admit dif- 
ferent degrees of differentiation in such features as vowel height, stress, and 
tone. A set Of feature specifications is called a unit or sometimes a segment 
A string of units is called a maimer a segmental jftrittg. 

Suprasegmental relations are relations among segments, rather than proper- 
ties of individual segments. Koi example, a syllable is a hierarchical relation 
between a sequence of segments (the nucleus of the syllable) and the less 

'Tie dtKUMKffl ta Liu ck*|*?r h t«3*d. prLroaiLly on the Himxj- presented t^ Noam. 
Cfcoiwky niid MdetLi iialle (19K} La the Senad Patlc rn ofEngtifti {SPE}. iTiiij moiiumeji 
i*l wflTk deiiiwd" Lhe field *f eeosiaLLve pho\u^i^^ Uj- foinialiiiBg cfimii] ideas ip. Ihe field. 
ijLdodinR lh* notion* of de ptiidrncr. procM*. ind linguitihcaJiy-rignEfetlll general ii4iion 
Ctamsky in.d HaJle cont:ni:r- "Tlmre is no point -nf principle Lnvoked li*re. i.*sd H> 
slrapLifr eipaiation ftli|iiLl.v -utc skill its unit ike set to be (dmitcd by id a priori Condition. 
A BJlniiir comment applied to [tie set of $p*dn<r*tionj]. n 
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$QIMTQns segments that im.Tncdi.aldy precede and follow it (the Onset and 
cndsL, respectively J. 

Rewriting rules formalize I tie notion of a p hanoloe-jcal process, that LS. a 
representation for the dependencies implicit in the surface matrices of a 
given language, An d'.ntflerKary rule, in of the form ZX AYW — <■ 2XBYW 
where A and B may be 4> or any unit, A ^ B; X and V may be matrices 
(strings *f Units), and Z and IV may be thought of Bi brackets labeled with 
syntactic categories such as 'S 1 or L N ! arid so forth. 

Some phonological processes, such &S the assimilation of voicing iCrOSS mot- 
ptc-mC boundaries., are very cara.rn.oa across the worlds .languages. Other 
processes* such as the arbitrary insertion of consonants or the substitution 
of one unit for another entirely distinct unit, sw extremely rare or entirely 
unattested . Foi" this reason , ill adequate phonological theories must In- 
clude an explicit measure of the naturalness of a phonological process;. A 
phonological theory must also define a criterion to decide what constitutes 
two independent phonological processes and. what constitutes a legitimate 
phonological general! sation- 

T»'0 centra! hypotheses of segmental phonology aie (i) that the most nat- 
ural grammars contain the fewest symbols and (jl) a set of rules represent 
Independent phonological processes when they cannot be more compactly 
combined into a single complex rule {Huule 1&61:1902). 

A complex rule,, then, is a finite schema for generating a (potentially infinite) 
regular set af elementary rujes. To a first apprcctimation. the complex rules 
of SPE are formed by combining Units with the operations of union, con- 
catenation, Kleene star., and exponentiation . using variables whose values- 
range over specifications, units, and syntactic categories, Johnson (1972) 
considers a more powerful class of complex rules, (and thereby, a different 
evaluation metric), as well as alternative modes of role application, 



*5<HTKnt4j mwkll belong id the dui of t-cmlacal rewriting BjrsLehtS iBklyied by Poet, 
rither L.-. ir. Id the local s-vi-.nnu due Id T'Luc. TLia is bev-tUtt' CQTOpkx rul** fl"! enm^*-- 
a Unite number of nomEDcal dependencies, and hence it* M*liU'DJ[ activity :if,^ifif-H hy a 
coanpLex rule cms irtec? parts <jJ the cut-in- de ci»itHMi ^trinp; .frpiTitcr] hp ui arbitrary 

4isu«e*. 

H ln jLihTi:;i>n : i? prCi.p-Mil , the rntpty string and each nut ire sctL-emaLa; Bcheana may he 
combined by th* operation 1; oF union, inlsnecLLim, negation, rilosnf BW, *P.<J CJCCiori ni- 
dation OMsr the set of tinals. Jahnwa aW TiS«* viai*fil«s and Boolean condition! in his 
Mh«D&U, This 'achwua langTa*^" is h ^jciTcmflLy powertul ch*racieriiaHDn ai Ihc dare 
;.f Tnc.nLi: l.tr^iiagr-.c fiv-rt tnr alphabet of units: it is no- used by pr*L - t-LLR^ phunulunis'-: 
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The complex rules are organised into linear sequence R ir R lr ,.. R^; they 
are applied in order to an underlying matriK to obtain a- surface matrix, 
Ignoring a great many issues than are important for linguistic reasons but 
Irrelevant for our purposes* we may think of the derivational process- as 
follows. The input to the derivation, or " underlying form" is- a bracketed 
string of morphemes, the output cf the syntax. The output of the derivation 
is the ""surface form," a striae; of phonetic units. Tte derivation consists ef 
a series of cycles. On each cycle, the ordered sequence of rules is appbcd to 
every maximal string of a nits containing no internal brackets, where eadi 
Ri +i applies fur doesn'; apply] to th^ n-Sult of applying thp immediately 
preceding ruie #,-, and SO forth. Each, comply rule J^ itself generates a- 
disjunctive sequence of elementary rule* R,^ , J?i,j H . . . in order of increasing 
generality. 5 That is, ft., generates a sequence of elemental y rules where R w 
precedes R iik in the sequence iff the preconditions of R,-j suhsumf: the pre- 
conditions of i^j^; the earliest JTjj that can appiy to the Current- derivation 
matrix is applied to it, to the exclusion of all other /E,,jt, Each elementary 
ride applies maximally to the current rfJeriva-tiOn string, that Is, simultane- 
ously to all units in the string. For example , if we apply the nile 4 -» B to 
the string A A, the result is the string BB. At the end of the cycle, the last 
rule R„ erases the innermost brackets, ajul then the next cycle begins wkh 

Becauj* a J5Jw*a complex mJt can rtptenent an infinite irt of fitment aij- tuL-w,, Johnson 
skzmx havr (he Iterated, CThauiuvG ipnlkatiiai d£ one complex ml* lo 4 eirai «£nierila] 
s-Lhnj c*n "effect vitiunlLj any computable m*pp*nig, H (p. ID] ihat jj, can f intuitu* tnrst 
T&f tomputaiiviL in a$l v one ttep of the dcrUtititm, Kti(., h* proposes 4 more icicrLcceii 
a 5LTn«L(*rieKnia" made of sp-piie-itiDn Ecu cDinplei: TuieB, *]uca lj- capih|<; of peafbmiin.£ it 
mcut a fin.itMtH.le JnappLnjj in 4B ,y singLi: appJicatLan. Tftifl Miej lint tire altering" mode at 
isle nppJk&tKHi proposed i* 5PE L3 Onlj- capable of pwfcrrariBg * BlxicUy finite mapping 
:a anv sinpjr rd- ippLicaticm. This mode of application, which. 1; vamiiy mo-H Cfciutrained 
than either of JohnflOb/B prapaiaJ*. U »Jw the on* uaed "by practicing pkonatngisU, Li Ibu 
eh-ipter we confer the qiiw!iBn Df whit ccsmfutatJODS can b* perlocnved by a finite ret 
if «l*-tnen,liry- rule?, «jij hence praridt verj- loose lu-iv^c bouadi for J.oJinjaa'i erc-waiv-ely 
pcweTful model. We note in tuning, however, that the pujtdeni of Eiirapty determining 
whether a pvta. ride ii subtumed Itf out ut John^a'a sdtwna m itseK wjtltlj :nliactablf , 
requiiinji. M leaa-l «ponentjiJ E.pi« (The idea af tfce- proof b ta conntriict Lto campki 
idlea: one- generate* -all poutble tlrinfft, mid ^le utJiei dMcirilws tkt valid cwnptaLatwiu af 
5™ epjacerbaandfid DTM- T'Jie Lattei ruk miv tw «rastmcted ly n^galdna the coBBHucLLDn 
■i"J«^ to HopcioEt J,E,.i TJUraan 1&T9:JSQI.J 

5 Tll* iiterpie^aticiri advocated. La SPE fp.JMff) b thai lh.e tru* fctimmai g is U, r Ml 
of e]eraen tar.v inlet; tJi* ^ake o( LiLs giamnifir ftiven by the tvalBiitiDn metij^, ia the 
sn-.al.r-hr iinii.j-.r of ::I.t ul-:i; . a\ Cealnrej qE any tjfl ,.■' of :: ir.-jlsx r-j>> Ltat ger.ciatr- !|-m 
net (T- Ch±ptfr D „[ Kenstoirici an<l Kbe*b«ith (t^S) contain* * | nE technkal BummaTy 
Of tile SPE sjatern Mid a dipciuiiaii QFiulMe<|'Uen.t rnn>dificatiima and emendations to it. 
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ihe rule R^. The derivation terminates when all brackets are erased. 

2*1.1 Complexity uf segmental recognition aft ^ generation. 

Let ua say a dictionary J? is a finite set of the underlying phonologicai 
forms (that is. bracketed matrices) of morpheme!;. These morphemes may 
be combined by concatenation and simple substitution (a syntactic category 
■s replaced by a morpheme of that category) to fojrn a. possibly infinite set of 
underlying forms. Then fC may characterize the two central computations 
of phonology as follows. 

The phonological generation problem (PGF) is: Given a completely specified 
phonological matrix i and a segmental erammar o, compute the su riace form 
j *= g(x) of x. 

The pfi tmologica I recognition problem (FRF) is: Given a (partially speci- 
fied) surface form. y n a dictionary D of underlying forms, and a segment al 
grammar g> decide- if the surfato form jy = g(x) can be derived from some 
underlying form x according to the grammar g* where 4f is constructed from 
the forms in D. 

Lemma Z.l.l The segmental model can sirmil6t£ ihe afmp-utaiion of any 
DTM M on any input m r using only elementary raits. 

Proof, We sketch the simulation. The underlying form * represents the 
TM input w, while tbe surface form y represent* the baited State of M 
on w. The instantaneous description of the machine (tape contents, head 
position,, stale symbol) is represented in "-1 >•■ string of units. Each unit 
represents the contents of 1 tape square. The unit representing til ft N:rrr-Eirl v 
scanned tape square will also be IpCcified for two additional fFatures, "c 
represent the state symbol of the machine and tho direction in which the 
head will move. Therefore, three features are needed, with a number of 
specifications determined by the finite control of the simulated machine Af . 
Each transition of M is simulated by a phonological rule. A few rales are also 
needed to move the head position around, and to erase the entire derivation 
string when the simulated machine halts. 

There are only two hey observations, which do not appear to hive been 
noticed before. The first is that contrary to common misstatement in lEie 
Linguistics literature, phonological rules Me- not technically context-sensitive. 
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Rather, they are unrestrk ted rewriting rules because Lhey -can perform dele- 
tions as well as insertions, This is essential to the- reduction* because it 
allows the derivation string to become arEjjtrarily long. The second o:> 
seivation ia that segmental rules can freely manipulate (insert and delete} 
boundary symbols, and thus jl H possible to prolong the derivation indefi- 
nitely-; we need only employ a rule B„_, at the end fifth* cycle that adds 
an extra boundary symbol to each, end of the derivation string,, unless the 
simulated machine has. halted. Tin- remaining detail are straightforward, 
and are therefore omitted, QThe immediate consequences arei 

Theorem 1 PGP is undeeidable. 

Proof. By reduction, lo the u n decidablo problem w g L(M)1 of deciding 
whether a given TM M accept* an Input n?. The in pat to the generation 
problem consists of an underlying form j that represents u? and a segmental 
grammaj j that simulates the imputations of M according to lemma 2.1.1. 
The Output is a surface form y = $(x) that represents the halted coafigura- 
tifin of the Thf, with all but the accepting unit erased. □ 

Theorem 2 PRP it tmrfcci'daWe. 

Proof, By reduction to the undecjdabte problem L(M) = #! of deciding 

whether a gjven TM M accepts any inputs. The input to the recognition 
problem consists of a surface form & that represents the halted accepting 
State of the TM. a trivial dictionary capable of generating £*, and a seg- 
mental grammar j that simulates the computations of the TM according to 
lemma 2,1,1. The output is an underlying form z that represents the input 
that. M accepts. The only trick Is to construct A (trivial) dictionary capable 
of generating all possible underlying forms S*. fj 

bet us now turn to consider the range of plausible formal restrictions fin the 
segmental model. 



2.1.2 Restricting the segmental model 

We consider ways- to bound the length oF derivations, limit the number of 
features, and constrain the form of phonological rewriting rules, a$ well as 
their interactions. 
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The first restriction is to eliminate complex rule*- In particular, let us- Eiir.it 
complex rules to union and concatenation. This restriction i& piaAtslble (for 
the purposes of this chapter) because complex rules are used to model non- 
local phonological dnpendencies, and these dependencies are now modeled 
by the autosegmeutal model, which we examine iu section 2.2- 

Hounding the derivation length 

The next restriction is. to prevent phonological rules from inserting bound- 
aries. In the $PE formalism, all rules can manipulate boundaries, which are 
simply throe units specified [-f-fugmanx]. However, in the grammare" actually 
postulated hy phonologists, only the readjustment n»)es manipulate bound- 
arie-Sr bo let us formally prevent phonological mks from ever inserting or 
deleting a boundary, Now rufea that manipulate boundaries are properly 
included in the class of readjustment rules. 

Boundaries must he manipulated for two reasons, The first is to reduce the 
number of £yt]e$ In a given deration by deleting boundaries, and flatten- 
ing syntactic structure,, for examolu to prevent l l?\p. pri neology from assigning 
too many degrees of stress to a highly-embedded structure. The second 1-5 to 
rearrange the boundaries given by the syntax when the intonational phras- 
ing of an utterance does not correspond to its syntactic phrasing (so-callerl 
"bracketing paradoxes"}. En this case, boundaries are merely moved around, 
while preserving the total number of boundaries in the string. The only way 
to accomplish this kind of bracket readjustment in the segmental model is 
with fides that delete brackets and rules that Insert brackets. Therefore, if 
we wish to exclude rules that insert boundaries, we must provide an alter- 
nate mechanism foi bfntJlrtary readjuiitment. Fbr the sake of argument— 
and because it Is not too hard to construct such a boundary readjustment 
mechanism — let US henceforth adopt this restriction. Now how powerful is 
the segmental model? 

Although the generation problem is certainly decid&ble now, the recognition 
problem remains undctfdable, because the dictionary and syntax are boch 

'Jfot iU tewtj uatraejil iul«S jntUpiiLfttC bOTindifiW- tit general, raadjiiutmeml H*k* 
ItlAp th* surf*** fauns (ivei hy Llir Ay^ta* ima the underlying Carina orf the phenology. 
Fst nirripln. the-y irr usrd Lo map i.hstra.ct morphemes, sudi tut inllwtjun or agreeiDenl, 
into pkojiaingical rnilrices, a.ait to modify flyiltMtic CB-leg^ti, i£ wbnn Fifth Awhm La 
mapped Jjora a. noun La Lhe HrnUi: W a. HOUR plirWC III lit Jihaaolagj, ia opd*E IhM it hf- 

attiftiwl the <wTKetfiri*L-*tE^fl- 
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potentially infinite sources of boundaries: the underlying form i needed to 
generate any given surface form according to the paramu g could be ar- 
bitrarily lone: and contain an arbitrary number of bou a claries. Therefore* 
the complevi ty of the recognition problem is unaffected by the proponed 
restriction on boundary readjustment The obvious restriction then It to 
additionally limit the depth of embeddiugs by some fixed constant, (Chom- 
sky and IlaUe dirt with this restriction for the linguisLic reasons mentioned 
above, hut view H as a performance limitation, and hence dioofl* nut to 
adopt it in their theory of Linguistic competence.) 

Lemma 24-2 E&ch derivationat cycle can directly simulate any pfrfpnomiai 
time alternating Turing machine (ATM) compbf atitin using rtaiEjr eUmentury 
rules. 

Proof; By reduction from a polynomial-depth ATM computation. The in- 
put to the reduction is an ATM fit with input ill The output is a segmental 
grammar ^ and underlying form x ea. the surface form jr = g(r) repre- 
sents a halted accepting computation iff M accepts w in polynomial time. 
The major change from lemma L 2-i.I is to encode the entira instantaneous 
description of the ATM a Late (that is. tape contents, machine State, head 
position) in the features of a single unit. To do this requires a polynomial 
number of features, one for each possible ta]M square,. pluH one feature for 
the machine atat* and another foi the head position. Now each derivation 
string rejw^r.ls a lev*] of the ATM computation tree. The transitions of the 
ATM computation me encoded in a blotk B as follows. An AND- transition 
is Simulated by a triple of rules, one to insert a copy of the Current state, 
and two to implement the two transitions, An OR-transition is simulated 
by a pair of disjunctively-ordered rules, one for each of the possible suc- 
cessor states. The complete rule sequence consists of a polynomial number 
of copies of the block B. The last rules in the cycle delete halting states, 
so that the surface form is the empty string (or reasonably- sized string of 
'accepting units) when the ATM compulation halts and accepts. If, on the 
other hand, the surface form contains any non halting or non accepting units, 
then the ATM does tlOt accept its input to in polynomial time. The reduc- 
tion may clearly be performed in time polynomial in the size of the ATM 
and its input. Q 

Because wc have restricted the number of embedding* in an underlying form 
to be no more than a fixed language- universal constant, no derivation can 
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consist Of more than a constant. nuraW of tycles-. Therefore. 1-emcp.a 2.1.2 
establishes the following theorems: 

Theorem 3 PGP with founded embedding and ttefnentarg nikt is PSPACE- 
ftflftf- 

Praof. The proof is an i.]::n:r:r|if!.te :T>nsequence of If mma 2-12 and a corol- 
lary to the C httidra.- Kozen- S tockmeyer theorem (1961) that equates poly- 
nomial time ATM computet ions anri PSPACE DTM compulations. Q 

Theorem 4 PRP with b/mnd&t f.mitedtSinss and elementary rvfev it PSPACE- 
luwtt. 

Proof* The proof follows from lemma 2.1.2 and the Chandra- Kozen- Stochmeyer 
result. The dictionary consists of the lone unit that encodes the ATM sU:t 
JDg configuration (that is, input ui. start State., head on Leftmost square). 
The surface siring is either the empty string or a unit that represents the 
halted accepting ATM configuration- Q] 

There is some evidence that the PGP wjth hounded embeddings and ele- 
ment *ry n;lc!f i.s also inside PS PACE. The requirement that the fCCluaL&n 
be polynomial Lime limits us t-u specifying a polynomial number of features 
iwid a polynomial number of rules, £3nca each feature corresponds, to arc 
ATM tape square and each segment corresponds to an instantaneous de- 
scription, this hind of simulation seems limited to PS PACE ATM compu- 
tations. Since each phonological iute corresponds- t<> a. n^xt-move relation, 
that is. one time step of the ATM, the simulation appears further limited to 
specifying HTIME ATM computations, which correspond to F SPACE DTM 
computations. 

For the PBX^ the dictionary (or syntax- Interface) provides the additional 
ability to ncndeterniinislLcsLliy guess an arbitrarily loug, boundary -fret; un- 
derlying form i with whkh to generate a given surface form jf(i}. This 
capacity remains unused in the preceding proof, and it is not Eoo hard Lo 
see how it might lead to undecldability, 1 

T Wt dnJyT be Citrful h how^f, tQ mike otit assumption.! &bou.' r '.'it r^c jnrri" li moo:, 
peifecdj-- cipLictt. [f opi-iona] chIei ue eatLceLj unKstrWe^t, IhiB thtj (M iifii'uUt* tfl* 
bounilnd nandetwunJuiEm mil ifcr PGP tfiiUJd be &* ™ropJEic u the PR] 1 , wbkh liifl iccat 
tu :hf: iiii'riuijrir1i:i1 iiuCidfiLii-rriLcjiim of the dicti.c\n*rY. S-t?6 fcotiou 1 8-. 

1 Ai w*: emf abow, the morpheme d:c J .iDaai) /BrmiX-LtttciFM* p-IQvide* to,* ibQily to 
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Limiting t|te number of features 

Another tOtnpuUtional restriction }g to limit the number of phonological 
features. 

The number of phonological features has a significant effect on the compu- 
tational complexity of pitunoirjgicaJ processes, because e*eh binary feature 
provides, the derivation with a tit of computational space, (This is true even 
though only a small, fixed number o: features- were needed to prove unde- 
CLiiahility rrf I J RP and PGP; In thrift reductions, each segment simuJa-ttd 
a Upc squaje.j As Chomsky and Halle noted, the SPE formal system is 
most naturally seen as having n variable (unbounded] set of features and 
specifications. This is because languages differ in the diacritics they employ, 
as well as djfferiag in the degrees- of vowel height, Lone, and atreBB they &]>■ 
low. Therefore, the set of feature* must be allowed to vary from language 
to language, and in principle is limited only by the number of rules in the 
phonology' the set of specifications, must likewise be allowed to vary from 
language to Language. 

Yet there is an important distinction to be made between the diacritic fea- 
tures and the phonological features. I}i&critks are properties of matrices, 
white phonological features are properties of units. Diacritics are used only 
to control the derivation — they are never affected by it. No rule ever rewrites 
the value of a diacritic, So even though the phonology must have access to 
Ml unbounded number of diacritics, it cannot perform unbounded compu- 
tations on them. 

That Leaves us with the phonotoglced features, which we can further sepa- 

non:kiet)Limi5LLca% goes* an Mbittarilf Long nndfStljrilirT, iota, x with, wfckh U> s *.ciate 
a «mn. eutkcE farm g(j) (in the tOuteil at tkr. FRP only), We CU hum«* this pawx 
U i« can encode the ra.Li.re TM fonipuutiDn in i sbi^L-n K^ftTnarlK] taring. Ctrmpte* ruiea 
will raiiK thit *(i**a TniderJj.inji form describes a Le^al compiitAiiun airing. l*t Ufthl 
«l«d* Cape iqiiares. ■* ij, t}, e p. roD [ af lemnii J.] 1. nqoinog a nsoft numrjcj rf fe*lnr«. 
]]f- \B.6te\d, »/c let eirh. unit, rbtoiir a oumplete in*t»JLtitt*oiiB dwcriplioPi, u in the proof 
of ItluUi, 2.1.2. ikcm wt wtl] hi.<tt proved thki the FRF L* EXPPOLY tirer JumJ. tiling an 
rniboLiadcd nuraWf oE teatniEi.) A? l>«fe», ike dicEionuy grner*tc& all itrinHfl *f umtn. 
■CMMrpouddcig in *0 pujjBible tDrapn tatifvns The se.Eir.En'.a. grimrsnj eanHisiR nf thiw 
*t«c6, [n tbe first rtige, ^Luonat ruJ«p noHirjIee^cininjBtscaJL? Bpedfy tKe uaiti; in Ids 
Mcand aiiftf adjacent uniLs at? ch-ecked Id Eniure that L\h*y ofcrtv Ifas neit-me 1 ™ relation 
of ike TM, uvd if thejT dmi't ibejr *re mwifd is Illegal; in tfcr- thild BUgE, the-oomjuililinii 
alAa S is i^du-ced w a B LaglE unit, whitn ia eilBJcr TQattaf m LU#i*l ch ai re Patent tag a 
hjj1*l *cwpttc. E sill* r,f tkt uinduQE. The Tf^Mrtiwn ia tDnndsrably simpjE-i umtij; (.twr 
aonJoraJ P&jt retrnting ipecificd If imnpte* jukn. 



rate into two classes: articulatory and suprasegrpental. The supraScgmentftl 
features, such as degree of Stress, is the topic of tbe next sCCtioni- So let us 
examine the articulatory features here. 

There are a fixed number of articulatwy features, on the order of 10 to 15, 
determined by (he musculature of the vocal apparatus. It is also true that 
there is an upper limit Co (he number N of perceivabLe distinctions thai any 
one phonetic feature is capable of su pporting. Therefore, it is an empirical 
fact that the number of possible phonetic segments is fixed in advance, for a]] 
human languages. And ?rnm a. computer science perspective, this number is 
small, between a thousand ami a million. 

If w* till* the** empirical upper bounds seriously then the PSPACE sim- 
ulation described in Lemma 2,1-2 would no longer be alloiwcd, became it 
requires an unbounded number of features. Although the undeddable TM 
simulation in lemma 2,1.1 would not be affected by this constraint, because 
it only requires a (very small) fixed number of features, (hie simulation is 
independently excluded by the proposed Limit on the number of embeddings. 
However., usine, the ideas in footnote 6, we. would Stilt be able to prove that 
the PR.P is underidUble. 

On the one hand, tfiia fact provides a convenient constraint on the complex- 
ity uf the PGP. ttaL tun be defended SOlfcly on empirical grounds. On tbe 
other hand, this fact does not Lead to any insight or understand ing, and it 
is difficult to defend such a trivial constraint on scientific or mathematical 
grounds. 

To fix the number of segments complicates the linguistic theory needlessly, 
requmnc an extra statement whose only consequence is to block a certain 
class of complexity proofs, and inhibit the search for more signifLcatit con- 
straints. It has no other consequences, and if a new feature was discovered, 
the bound wouJd only be revised upwards. Therefore, the proper scientific 
Idealisation is that the phonology has Ml arbitrary articulatory base (as seen 
in sign Languages). 

Tbe purpose of this report is to illuminate the computational properties of 
human language, as a function of the natural parameters of variation, using 
the tools of computer science. We kno^' that the number of phonological 
distinctions (that is, features and specifications] is a natural parameter of 
the phonology, because it varies from, language to Language. We also know 
that this parameter affects both the computational and informational COm- 
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plexity of the phonology, and for that reason it miast be included in an 
honest mathematical analysis. To exclude it from consideration is only to 
blind ourselves to the computational Structure of the system, Therefore, 
the idealization to ftp unbounded number of features is necessary on purely 
mathemati f.al giounds. 

Such a fixed bound Is also at odds with a fundamental insight of the SPE 
system. A central component of SPE is the complex rule formalism, which 
characteiizfs the ciass of linguistically significant generalizations. The cen- 
tral different* between complex and elementary rules i* that complex rule* 
naturally describe nonlocal dependencies, wfi e-reas element ary rules are „nv 
ited to describing local dependencies. The central prediction of an evaluation 
metric defined on the complex rules, then, is that nonlocal phonological de- 
pendencies are as natural as Eocat dependencies. In other words, the class of 
phonological dependencies cannot naturally he encoded with a finite-state 
automaton. Yet, when w* fa the length of derivations and maximal number 
of features, we limit the phonology to only describing finite-state dependen- 
cies. 

I return to consider the nature of unbounded idealizations: in a more general 
setting in appendix A. 2, 

To my mind, the most telling reason ncc to fix the number of artieutatory 
features is that it is 4 jejune constraint that does not itself lead to any un- 
derstand JEtg. Even worse, it distracts us from the truly interesting research 
questions, such as whether features do in fact Correspond to reusable com- 
putational space in the phonology, as we have used them in the reductions. 
When we block the reductions by fixing the number of features, we do not 
answer this question. All *e do Is make che question irrelevant,, becau.8* to 
&K the features is simply to ignore them. So, for the purpose of Increasing 
Our understanding of huma.n language, !et us keep our idealization to an 
unbounded number of features, and prweed with the investigation. 

Restricting the rewriting rules; 

In Order to bound the time resources available to the phonology, we have 
considered limiting the number of derivational cycles directly, and indirectly, 
by restricting the class of readjustment rules. We have also examined ways to 
bound the space resources available to the phonology, by limiting the number 
of phonological features . Although these purely forma] restrictionft block 
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a class of reductions., and constrain the class of phonologkaJ computations 
(acid thereby the dass of characteriiable phonological dependencies ), neither 
suffices to eliminate the intractability that is inherent Lr. an unrestricted 
rewriting system. This raises the question, how might w restrict the rules 

tfrjUMllvrt! 

Element &ry mh;S are used iu at least six Ways; (J) to convert binary phono- 
logical features to n-ary phonetic features, for example, the nasal feature in 
SPE; (ii) to male a unit agree or dis-iitgrw with the features of an adjacent 
unit, that ie, to represent assimilation. Mid dissimilation processes; (ili) to 
insert units that ate entirely predictable, as in English epenthetic vowels; 
(iv) to delete units that violate weii-iqrmeduess condition* on represents* 
tion^j (v) to swap two adjacent units, which i-^ lilted metathesis.; and (\i) to 
derive irregular surface foiEQS, M in the English *fgaf + <P**t> -* [toCTlfl'r 

Abstract words arc rewritten as segmental s-timss ]n I he interface between 
syntax and phonology (see chapter 3}. The derivation of irregular and regu- 
lar forms are identical from this perspective; both are simply the arbitrary 
rewriting of abstract morphological constituents into segmental strings. The 
first restriction on elementary rules, then, is to limit the eLass of arbttraiy 
rewriting? to the interface between phonology and morphology, and to ban 
the arbitrary rewriting of segmental string* from the phonology proper. 

Rules that delete, change, exchange, or insert segments —as well as rules that 
manipulate boundaries — are crucial to phonological theorizing^ and there- 
fore cannot, be crudely constrained ? More subtle and indirect restrictions 
are needed fat these rules.' 03 

'One TKKtiLctJDa pro-jHHed La rLr literature, it MeCs-filir'i (lUSlii'OS) H mDiptemr juLe 
tcaulrunl" (URC) r Trkicn requires oil nnorpkoliJgk*] Fides ta be of tiie form A — HfX 
whbtt A IB b. unit Of ^, aAC B 40.4 X UC (]MMsib3r a'lU) a-Liines iif IiiisU (A' La the imme- 
4iHv context of A. «■ trie right ot left.) Tlie MEIC (Ldei idl oo-nauaui Ui- LDnpuLaLiDiiB- 
C0lt1J>]exit>" uf rfkjnHJii: tl pliuiiology bnriui* individual rule* cbji h1j!L insert and deiEie 
f*[|TOL'Tiii, icd gijynpji of rulKS can be c&oadL anted lc peifi/rlil irUttity lewtililg, 

"Tli*-! ^kDimifcr and. Halle were -welll a^aie of tilts* ptoWicm* IB bey&ad doufciu "A. 
pasaibl: diiedian in ntldi oae raipJH Lira* br auih ill extension oFike tlieoTj- if. AUftgitsu^l 
bjf etrtalfi Qlh*r tit in dial lit r«H liaiidUd wUh ^JWBplEifi adequacy La tJic pieseat '.keory. 
C'jjibL'Ji-j first die muiatc in ^lucb the jyjQcrs* r>f znetaikEsia waa treaiEd in ChaptEi 
EIlIiI-, Sec tU>n 5. Aa i*-ill hi tECaJfeC, «*4 w*IC far^if. ikEie Id uLe advantage of jwjwerfjj 
[rAnF,riTiTmi.ii^iiiJ mft.^h'iriCTy at the fail tJiir u used Ln the pja(an. Tbia- Increase in (Jie 
pawEi oFlbE raini*! device* of phanolDy did not ueeht fstly jnsiifiitf eincn it w*4 niide onij 
ra kajulle a maiEJnal type af pkenoraeaojl . An B](*cn+iLve wty to ackieT* ike iimr. TesalLs 
is (O intiodtm 4 epKisJ devk* which would be inlerpcrlvd 1? 'rli-v 'j'jiLvriilioiir an Tale 
n.pplicn.ci^n as. hn,vin| th*' dT-C-ct fit" prTEnuiinji ike sequErtial -order ef ft pitr of segjaeula-." 
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One m direct restriction is to limit the possible interactions, among rules. 
Ueraiise segmental ejammaTS do not have a finite state control, all rule 
iuteiaelions must arise via [)j,e derivation form (that is, the sequence of seg- 
mental strings that is the computation string for the segmental derivation^ 
The computationally stgnirk.inr :.-ni-r;wi..",;is are ones that uss th* derivation 
for::i 1.0 store intermediate results of computations. The segmental model 
allows one rule V> make a change in the derivation forrm and a subsequent 
rale to make a change to this change, and so on. A segment that is in- 
serted can subsequently he deleted; a segment that is switched with another 
segment can Subsequently he switched with another segment, 01 deletedl- 

We have every reason to believe that such inceptions are not natural The 
underlying form of a word must encode all the information needed to pro- 
nounce that word, as well as recognize it. This information mnst h-e readily 
access) hie. In Order to ease the task of Speaking, as well as that of acquiring 
the underlying forms of new words. The underlying form of a given word is 
that representation that onute all the directly predictable information in the 
surface form. The methodological directive "omit predictable information" 
means that a feature or segment of a Surface form must be omitted if it is 
directly predictable from the properties of the phonology as a whole (such as 
the structure of articulations or the segmental inventory), or from the prop- 
erties, of that particular surface form, such as its morpheme clats^ adjacent 
segments, or suprasegmental patterns. To a first approximation, "directly 
predictable" means "^computable- by one rule with unbounded context and 
no intermediate results.* 

In point Of fact., insertions and deletions do not interact in the systems 
proposed by phonologists. l/nits are inserted only when they appear in 
the surface form, and are totally predictable. Such units axe aevei deleted, 
jli'ciuse inserted units aren't deleted, and because an underlying form is 
proportional to the sine of its surface form, the derivation can only perform 
a limited number of deletions, bounded hy the Sl£l- of the underlying form. 
In eenera], deletions typically only occur at boundaries^ in order to "fix-up 71 
tie boundary between two morphemes. Because underlying forms cannot 
consist solely of boundaries, we would expect the size of an underlying form 
to be proportional to the size of its surface realization. 

The immediate consequence of this ^direct prediction" property of segmen- 
tal rules is that underlying forms cannot contain significantly more segments 
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or features than their corresponding surface- forms. It is also true that the 
derivation add* predictable information to the underlying forth id & nearly 
monotcnic fashion. The next restriction is to severely limit rule interactions 
in the segmental model: to exclude tin.- storing of intermediate results in 
derivation forms, to require ail derivation palhs- to accept and to be nearly 
monotonia Deletion phenomenon might be modeled using a. diacritic that 
Mocks the insertion of the "deleted 11 segment, Tlie details of such. a(nearly or 
s;ricily) rilOfiOtOnk mode] must, of course be worked out- But it is promising, 
and if plausible, as It seems to be, then the simulations In footnote & would 
be excluded. This is one formal way to define the notion of "predictable 
InformAtlon, 7 " which, bwed as it is in the fundamental notion of computa- 
tionally accessible information, seems more coherent and fundamental than 
the notion of a ''liflgnisticalLy-sifrnificini generalization," which has proven 
elusive, 

2.1.3 The SPE evaluation irittric 

The SPE evaluation metric is a proposal to define the notion of a natural 
rule and Linguistically- significant generalization. At first glance, this pro- 
posal seems vicnous, In order 10 minimize the number of symbols in the 
gramma^ nbserved surface forms should simply be stored In the dictionary 
of underlying ferais. Then the number of symbols In the grammar is zero, 
and all the linguistically significant genCfaJizafious in the corpus have been 
discovered, that in, none. Clearly, this is not what Chomsky and Halle 
intended- 

Pcrhaps tlift sisc of the dictionary must be included in the metric is well, 
N'ow the most natural phonology Is the smallest grammar-dictionary whose 
output is consistent with the observed corpus. The solution to this problem 
is also trivial: the optimal 0^1™^^-!!^^*™^^ wiuply generates E - . 

So the simptest coherent revision of the SPE metric statei! the most natural 
phonologic*] system is the emalieat grammar-dictionary that gtntra.t^¥ vx 
actly the finite set of observed forms," Ignoring questions of feasibility (that 



'La rhia wt ldcpt a staadard assumption of tht field, IhfL tlift lanpruajf ar<nai5i:inr 
drvk* Joes au-L have access to negative erideMLM. If irc (alive evidence were illowed, ibcn 
tl» SPE IWPITJC would toe revit«l to Sl-H-lf thai the moil natural SYs"»em is llie tsmaJJesl 
gcacnmar-d.icLioc.arv ranMSLeat wiLh lac Evidence. Lh*l is, iiW*n :s *■" [wi'livf r-v Ann pies 
and. jejecla ail negative example*. T'h.15 appTMca b prerniFini under the weak definition 
d[ "negative evidence' is "abiience tif tohJirea*iion- T 
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tBL how to algorsthmJea|ly find such a system), we run into serious empirical 
problems because the observed corpus is always finite. The smallest gram- 
mar will always take advantage of this rinEteness, by discovering patterns 
not yet falsified by the set of observe^ surface fonn&. The underlying forms 
in such an optimal grammar-dictionary system wilt in fact look nothing like 
the true underlying forms, that is, those postulated by phonolngists on the 
basis, of scientific evidence (Lil is not available to the language acquisition 
device {LAD), And even, if the set of underlying forms is fixed., the optimal 
grammar in inch a system will sr.il! hot be natural, failing standard empirical 
tests, such as those posed by loan words and language change. 12 

This observation is- confirmed by the comptexity proofs. An important corn], 
lary to lemma 2,1,1 is that segmental grammars form a universal basis for 
computation. It is possible to simulate an arbitrary Post tag system using 
a very simple set of phonological rules. Or we can simulate the four-symbol 
Seven-state "smiles! universal Turing machine" 1 of Minsky (1%7) in the 
segmental model; the resulting grammar contains no more than three fea- 
tures, eight specifications, and 36 trivial rules. These segmental grammars of 
universal computation contain significantly fewer symbols than a segmental 
grammar for any natural language. And this is not even the best that can be 
done. The smallest combined grammar- dictionary for the set of all observed 
words will be even smaller, because it can take ad vantage of all computable 
generalisations among the finite set of observed surface forms, not only the 
linguistically significant ones. In fact, the attached dictionary would repre- 
sent the Kolmogorov complexity of the observed surface forms with respttt 
to the optimal segmental grammar, thai is, the true information content of 
the observed surface forms with respect to an arbitrarily powerful encoder. 
Therefore., this corollary presents Severe conceptual and empirical problems 
for the segmental theory. 

In ahoft, even if we ignore questions at feasibility, the smallest segmen- 
tal giammar-aklionaiy capahle of enumerating the set of observed surrara 
forms cannot be natural because it must discover too many unnatural gen- 

*]ji my brief eipeiifn.ee as a pJianDlajwl, lu« CUM I naLural ftTurBttiais did TOl hive the 
?m*fltat humbcr of Kyui^ob. «»rn wlien ths punier mefrpacmJcdirmTtpowlJaD ciF undellybig. 
fwm* wis Wnm in arkujKr. WnJi EQD u R h tSmw WnS mentil dieciplinc. it wm AUays 
panLbl* Hi eOMLrLic! a traiJkr ^rMnniBj lian. the *c^r[«t" one, by l*](iri 6 advaatjgf e>i 
J -un.n.atuiaT pnUe/ni in Lhe Ghflf.[v*d iuifaos fnrnni. J^reMing Lbr Tiumbn af eimipltt 
dDti nr.t help, flLmplf becatpw there *kl] never h* enough. examples to rictunle fel the 
fQiiipuiable buc unn*igral patleiHi. 
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eralizations. 

How then can we make sense of the SPE evaluation metric? The evaluation 
metric mikes certain sets of disjunctively ordered elementary rules as nat- 
ural as an elementary rule. The fundamental difference between a complex 
rule and an elementary lisle is that a complex rule is capable of performing. 
nonJacal Post-style rewriting, whereas elementary rules are limited to local 
TEiue- style, rewriting. Therefore,, the SFE evaluation metric formalizes the 
observation that nonlocal phonological dependencies can he as natural aa lo- 
cal ones. The only difficult is, ihf. rv> I ativeiy subtle distinction between local 
and nonlocal rewriting is overwhelmed by the brute power of an unrestricted 
rewriting system to encode arbitrary i.e. dependencies. 

This observation suggests a solution, and a promising, line of investigation. 

The early evaluation metrics included not only a measure of the number 
of symbols in the grammar (Kolmogorov complexity), but aiso a measure 
of the length of derivation* (lime complexity). So, in Morplwphonemics of 
Modern HebrsK, Chomsky (1551) proposed a mixed evaluation metric: 

*Given the fisted notation* the criteria of simplicity governing 
the ordering of statements are 4s follows: that the shorter gram- 
mat is the simpler, and that among equally short grammars, 
the simplest is that in which the average Length of derivation of 
sentences is least. 1 " (p.6) 

"The Criteria for justification of ordering are as given at the 
conclusion of section (I: simplicity is increased by 1, reduction 
Of the numbet Of symbols in a statement (paired brackets, etc., 
counting as one symbol); 2. reduction of the length of deriva- 
tions, with the second requirement subsidiary, Actually, it ap- 
plies only once, and then in a trivial fashion. I mention it only 
to indicate explicitly that this consideration taken as subsidiary, 
will not materially increase the ordering restrictions. 1 ' (pp.51-2) 

A similar proposal appears in SPE, in the context of how the conventions 
of conjunctive and disjunctive ordering should be applied; 

A natural principle that suggests itself at once is this: ofitfett- 
Ql#rtf nfiiftlifJitF must fa jHflJaclflrf in such a iray us to maximize 
disjunctive trnttrirtfr .... The principle seems to us a natural 
one in that maximisation of disjunctive ordering will, in general, 
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minimize '..he length of di-rivations in the Ejammar. The question 
df how an internalized grammar 19 used in performance Speech 
production nr perception) is of course quite open. Neverthe- 
less, it seems- reasonable to suppose thai the grammar should be 
selected in a such a way as to minimize the amount of Compu- 
tation 1 that is necessary, and tliat "length of derivation 1 is one 
factor in determi niit£ ^complejdty of computation 1 . NatufaJhjV 
thjs principle- must be regarded as ouite tentative, We will ad- 
here to it where a choice arises, but we have very little evidence 
for or agstinst itr To find empirical evidence h^.\ririg On a princi- 
ple of this degree of aWtraCtness is not an easy matter, but the 
issue is important, and one should bear it in mind in a detailed 
investigation of phonologi cat structure, (SPE, p.63). 

As stated the addition of complexity concerns doe* Hot make a difference, 
because tbe derivation- length. :s strictly ordered withjn the symbol-count. 
The idea of com oj u lue, Kolmofiorov and computational complexities is at- 
tractive, however > for all the reasons mentioned. Let us therefore replace the 
SPE/ Morphophonemics metric with a metric inspired by the time- bounded 
Koimogorov complexity of Levin (1OT3), Let timefoiO be the number nf 
steps taken by grammar § to produce surface form §{u) oil input underly- 
ing form u. Then the Complexity jC(j, D) of a phonological grammar g and 
dictionary of underlying forms D is: 

*(* J?> = Iffl + £ M + tifnefoft) 

ueD 

A grammar- dictionary (0],iJj 1 is p refcrrr-d over another grammar- diction toy 
(»*£») when (i) it is less complex (£(f,,£i) < fC(^,D 2 ))\ and (ii) both 
are CKtensionally equivalent ({ffi(tt) : u e i?i} = fefu) : u e £? 3 }). 

Now it is possible, at leaet in principle, to find the optima] gramrnar- 
dktionary grammar, by a simple sequential search. And tlLe phonology is 
Only able to discover efficiently computable and simple patterns, a potential 
improvement over the STE proposal. 

Although this evaluation metric solves :U h/rhmcal problems of earlier pro 
pesals, it is not clear that it would result in natural grammars. In my 
opinion, the notion of a 'Imguisticatty significant gruerali z at ion" is best for- 
malized by postulating a vrcak encoder, that can vnlg discover linguistically 
significant generalizations. The evaluation metric, rather than the symbol 

32 



count of the grammar, is Lie minimum, description length. criterion applied 
to the set of observed surface forms, which are encoded relative to the model 
class of restricted direct-prediction phonologic (cf. h KJssanan 1&78), Thai 
way, in order to minimise (lie encoding of the set of observed surface forms, 
the grammar mu$t discover the linguistically significant ^eneializations after 
having; seen a Sufficiently Sarge (finite) set of surface form*. The grammar 
is also forced to describe phrase-level phonological processes, because no 
finite word/roOrpheme dictionary is capable of doing so. The research chal- 
lenge, then, it to design *uch a probabilistic model class for phonology. The 
modem autosegmenlal model seems to be 4 good place to start, because 
suprasegmental processes are a Large class of the phoDologically significant 
generaliBatJons. 

2*1.4 Modeling phonological dependencies 

In SPE. knowledge of phonological dependencies, is modeled with an uti re- 
stricted Post-style rewriting system, Such a syfltem is capable of encoding 
arbitrary i.e. dependencies in the derivation of surface forms from underly- 
ing forms. It forms a universal bafil5 for eompntable knowledge. 

We know that phonological dependencies can be complex, exceeding the 
capacity of a finite- state encoder. However, not every segmental grammar 
generates, a natural set of sound patterns. So why should wc have any faith 
or interest in the formal system? The- only justification far these formal 
systems then would seem to be that they are good programming languages 
for phonological processes, that clearly capture our intuitions about hu- 
man phonology. But segmental theories are not always appropriate, Their 
notation Is constrained,, whkfl limits their expressive power. Interactions 
among phonological processes are hidden in rule ordering, disjunctive or- 
dering, h locks, and cydicity. Yet, despite these attempts lo foitnabiie the 
i k ■-.■!: i. i : T ;i -i;lh r;:' |ihuin'jlngif.fu rlppeiulency, it is possible to write ;>. *<:c.- 
menlal grammar for any recursively enumerable Jet. 

Natural phonological processes seem to avoid complexity and simplify in- 
teractions. It is hard to find a phonological constraint that is absolute and 
inviolable. T3iere are always exceptions, exceptions to the exceptions, and 
so forth. Deletion processes like apocope., syncopy, cluster simplification and 
stray erasure, as welt as insertions, seem to be motivated by the necessity 
of modifying a representation to satisfy a phonological constraint,, not to 
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exclude representations, to hide vast computations, Of CO generate complex 
sets, as we have used them heie. 

The next step in the research prelum initiated here is to design an appro- 
priate formal phonological model, along the ILms discussed above, in order 
to answer the fundamental questions of naturalness, appropriate generaliza- 
tion, and what seems to be the lynchpin of the phonolce^ the omission of 
directly predictable information. It is also now poasjhJe to discuss the notion 
o( computationally accessible information, wtii«b has played such an irnpyr- 
tant rok in modern Cryptography,, and to consider a more sophisticated — yet 
still constructive — complexity thesis for human language , based on the fun. 
damental ideas of entropy and computation. We might hypothesise that 
knowledge of phonology, and of aJl linguistic dependencies, is computation- 
ally accessible in the sense of Yao (l^SS), 



2,2 Autasegmental phonology 

In the past decade, generative phonology has seen a revolution in the lin- 
guistlc treatment of EopraseRmentaJ processes such as tone, harmony, in- 
fixation/interleaving, and stress ivsignment. Although these autosegmental 
models have yet to he formalized > they may be briefly described as follows. 
Rather than one- dimensional strings of segments, representations may be 
thought of as "a three-dimension*! object that for concreteness One might 
picture as a spiral-bound notebook,'* whose spine is the segmental String 
and whose page* contain simple constituent structures that are indepen- 
dent of the spine [Halle 1985). One page represents the sequence of tone* 
associated with a given articulation. By decoopling the representation of 
tonal sequences from the Articulation seqyf-ric;c, i; is possible fur sejnnetiLal 
sequences of different lengths to nonetheless be associated to the same tone 
sequence. For example, the tonal sequence Low- H igh- High p which tl used by 
English speakers to express surprise when answering a question , might be 
associated to a word containing any number of syL=ah|es, from two {Brazil) 
to twelve ifltKCinauw:inikilipi!iffcatiQn) and beyond. OtbeT pages (called 
''planes*) represent morphemes, syllable structure, vowels and consonants, 
and the tree of articulator}' (that is, phonetic) features. 
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2.2.1 Complexity of autosegmental recognition 

Now we prove that the FRF for au Kwgmental models Is NF-hard, a sig- 
nificant reduction in complexity from the underidable and FSPACE-h&rd 
computations of segmental thronus. (jNtvte however that antosegment al rep- 
resentations have augmented— but net replaced -portions of the segmental 
model, and therefore, unless. something can be done to simplify segmental 
derivations, modern phonology 1 inherits the intractability of purely segmen- 
tal approaches,) 

Let HS begin by t h i n king of the N P-COmpEete 3- Satisfiabili ly problem (3S AT ) 
as a set of interacting constraints. In particular, every satisfiabte Boolean 
formula in J-CKP ib a string of daunt Ci,Ci, - - - ,C P in the variables fi T s» T .. 
that satisfies the following three constraints; (i) [legation.! available Xj and 
its negation Zj have oppos-ile truth values; (ii) clausal satisfaction: every 
clause Ci = (a, VbiVti) contains a true literal (a literal is a variable or its 
negation}; (m) consistency of truth assignments-; every positive literal of a 
»L\f.-]L ■. a :'.,i '. : 1 1/ i-. i!M.ip; !■■■■! i;i?- -aiu-- Lrut:i ■.■:'.>■". ii:l...'i I or fl. 

Lemma 2.2.1 .4 utoscgfUcfliaJ representations can enjptet- tht SSAT WH- 
xtminis. 

Proof; Th* Idea of the proof is to encode negation and the truth values 
of variables in features^ to enforce clausal satisfaction with, a local autosee;- 
mentaJ process, such as syllable structnre; and to ensure consistency of truth 
assignments with a nonlocal iUtOSegmental process, such as a nonccmcale- 
native morphology or long-distance assimilation (harmony). Tb implement 
these ideas we must examine morphology, harmony, and syllable structure. 

ILf&rphfmt Interf&tviftf- In the more familiar languages of the world, such 
as Romance languages, wwHs iiri! Hnfmed primarily by the concatenation of 
morphemes. In othei languages, stich as the Semitic languages, words are 
formed by interleaving the segments of different morphemes . For example, 
the Classical Arabic word ksiaba. meaning 'he wrote', is formed hy inter- 
leaving fvrith repetition} the l segment of the active perfective morphem* a 
with the 3 segments of the ktb morpheme (cf,. McCarthy 198L). (Constraints 
on syllable structure, discussed below, explain why the 1 underlying vocalic 
segment /a/ appears 3 times in the surface form.} In the autosegmental 
model, each morpheme is assigned its own plane, We can us* this system 
of representation to ensure consistency of truth assignients. Each Boolean 
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viable z, is represented bv a separate morpheme y„ and bv^tv htera] of z, 
in The String -of formula. literals is associated to the one Underlying morpheme 

ffarmony. Assimilation is the common p hoDOlogfcal process whereby some 
9egnl«31t COmes Us share properties Of an adjacent segment. In English, conso- 
nant nasality assimilates to immediately preceding vowels. Assimilation also 
occurs across morpheme boundaries, as the varied surface forms of the prefix 
in- demonstrate: in-f- tcteralte — rniofcraWfi, hqt in-j-bxjitai -* if Jogicai and 
^+|jTK?oob^ — impflfrtolWr. In other languages, assimilation is unbounded 
and can affect non adjacent segments: these assimilation processes are r.pjicd 
harmony systems. In the Turkic Languages ail safhx vowels assimilate the 
bac);n#?ss fixture of Lhe Last atom vowel; in Capanahua, vowels and glides 
tlsat precede a word- final deleted nasal! (an underlying nasal segment absent 
from the surface form) are all nasalized, Li the autosegmentai model, each 
harmonic feature is assigned its own plane. As with morpheme-Interleaving 
we can represent each Boolean variable- by a harmonic feature, and thereby 
ensure consistency of truth assignments. 

Syllable ttntttwr. Words are partitioned into syllables, Syllables arc X]k 
fundamental unit of segmental organization (Clements and Keyser, 10S3), 
Each syllable contains one or more vowels 'V (its nucleus) that may be pre- 
ceded or followed by consonants S C'. For example, the Arabic word ka-.ta.ba 
consists of three two- segment syllables., each of the form CV. Every seg- 
ment is assigned a sonority value, which (intuitively) is proportional to the 
openness of the vocal cavity. Tor example, vowels are the most sonorous seg- 
ments 4 while Stops such as /p./ or /b/ are the feast sonorous, Syllables obey 
a language-universal sonority sequencing constraint (SSC), which states that 
the nucleus is the sonority peak of a syllable, and that the sonority of ad- 
jacent segments swiftly and monotonkally decreases. We can use the SSC 
to ensure that every cliuise C { contains a true literal aa follows. The central 
idea is to make literal truth correspond to the Stricture feature, So that a 
true literal (represented as a vowel) is more sonorous than a false literal 
(represented as a consonant). Each clause d = (flfVK V e,) is encoded 
a? a segmental string x - t 4 - x^ - x „ where JF is a- consonant of sonority 
I. Segment t a has sonority 10 when literal fl, is true, 2 otherwise; segment 
r*. has Sonority 9 when literal &,- is true f 5 otherwise: and segment i c has 
sonority 8 when literal ej is true h 2 otherwise, Of the eight possible truth 
values of the three literals and the corresponding syllabifications, only the 
syllabification corresponding to throe false literals is excluded by the SEC 
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In that case, tie Corresponding string of four COniOnaJlts C-C-C-C has the 
sonority sequence 1-2-5-2. No immediately preceding or following segment 
of any sonority can re-suit in fc syllabification that obeys tKe SSC Therefore, 
all Boolean clauses must contain a true literal- Q 

Tie only fac* reeded to obtain an NP-h*rdnesa result from this lemma £-2-1 
is the fundamentally elliptical nature of speech, as described by Jakobson 
:.iri Halle (195B): 

Usually ... the context and the situation permit US to disre- 
gard a high percentage of the features, phonemes and sequences 
in the incoming message without jeopardising its comprehension. 
The probability of occurrence in the apoken chain varies for dif- 
ferent features and likewise for each feature in different textS- 
For this reason it is possible, from a part of the sequence , to 
predict with greater or leaser accuracy the succeeding features, 
to reconstruct the preceding onea, and finally to infer from Some 
features in a bundle the other concurrent feat urns. 

Since in various circumstances the distinctive load ol" the 
phonemes is actually reduced for the listener, the speaker, in 
liia turn is relieved of executing all the sound distinctions in his 
message; the number of effaced features^ omitted phonemea and 
simplified sequences may be considerable tn a blurred and rapid 
Style of Speaking, The sound shape of speech may be no ks« 
elliptic than its syntactic composition- Even such specimena as 
the slovenly /tern mins sem/ for 'ten minutes to seven*, quoted 
by D. .Tones, are not the highest degree of omissiou and fjagmeii- 
tariness encountered in familiar talk. (pp. 5-6) 

The direct consequence of lemma 2,2.1 h and the fact that not all sound 
distinctions are executed, and those that are may be corrupted, is: 

Theorem 5 PRP jor the <mlQSe$rne-ntaI modd is NP-hard. 

Pj-L'mf. Us ii :ii::li:n U: \]'<.\1. Ti.f: idf •?-. IS I:) I'.Tr;'. ii.il ;■- -,:i i I'itc,- l"i : rrn \':w.\ 

completely identifies the variables and their negation or lack of it. but does 
not specify the truth V-ituus of those variables- That is, the stricture feature 
has been ellipsed. The dictionary wJU generate all possible underlying forms 
{interleaved morphemes oi harmonic strings } t one for each possible truth 
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usdgnment. and the antosegmental representation of Lemma 2.2.1 wilt ensure 
that generated formulas are in fact satisfilbk. □ 

2,2.2 Supra segmental dependencies 

It ie informative to EMPMHaiiajfl these suprasegmental processor from an 
information-theoretic perspective, The relationship between the sound of 
a. word and its meaning ;s inherently arbitrary, A given Heqnen.ce of articu- 
lations could in principle mean anything: a given meaning coulc: in prii.dpk 
have Any articulation. And jt sroms that the storage capacity of the human 
brain has, far all practical purposes, no limit {cf„ Luria IMS). 

Yet there appear to be nv,i primary sflisrres of phonological systemalieity, 
that La, of sound patterns both among and inside surface forms. 

The phonetic systemalidty in the mental lexicon arises from the fact that 
words- consist of morpheppe combinations. Although words that share mor- 
phemes need not in prindple share phonologitjiJ patterns^ most in, fact do. 
This mahes ]t easier to acquire words,, arid to invent them, because the mean- 
ing of a word is edven by Lta relation to other words, as well as by its intrinsic 
content, A regular mapping from morphology to phonology simplifies the 
acquidtlon and invention of new words. 

The phonetic syslemalidty In a surface form is due to suprose^mental pro- 
cesses. A Bnprasegmentid process p establishes the domains within which 
One element in each domain, the h*id> is distinguished phonetically from 
the other nonhead elements in that domain- There art three parameters of 
variation: 15 

1- The phonological representation r on. which p operate^ including- syl- 
lables and any node in the tree of articulator}' features. (The elements 
of t are called the u fr bearing" units. 1 *) 

2. A restricted dass of trees, whose leave* are attached to the p- bearing 
units, Each nonterminal in such a tree immediately dominates one 
head and a (possibly emptj) set of nonheads, thereby representing 
a supraseginental domain. The domains defined Ly these trees are 
efflatjffuous and exhaustive, 



fkii lacampkL* propMil ii in*pi[M by Ike EsiUt and VcignmA (1B87) irottmttit oT 
pfs^clapcJitTfSs, and by canKTUtiaaa «Uh Morris HaJLe. 
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3, The entirely local process that realises the abstract distinction between 
heads and nonheads Jn the phonetics. 

.Suprasegmeiital processes maintain systematic distinctions between adjacent 
segments of each Surface form, as weU as ensuring that segmental strings 
have global properties^ and thereby contribute to efficient production and 
error-correclinfi comprehension (cf. JakobEora and KaJleL 195G)- 

Syllables organise the phonological segments of a given languages A string 
of segments is a possible sound Lf Mid only if it can he partitioned into a 
sequence of substrings, each of which correspond* to a permissible sylla- 
ble. Syllables represent, in part, the sonority hierarchy between the nucleus 
vowel and its consonetltai Olivet Mid co4a. Syllabic domains are given by 
the language-universal sonority hierarchy as welt as by language-particular 
constraints-, that may be represented with a small set of syllable templates. 
such as 'CV 1 and l CVC\ 

1. Segments- are tha syllabi a -bearing unita. 

a. local sonority maxima are inherent he-idi , 
2 . C oinput a ay Liable domains . 
3. Perform segmental adjustments. 

a. insert or delete unite to satisfy constraints, 

The stress- bearing units of a language are either entire .syllables, or their 
moras. 1 "* Stress domains art- defined by a class of finite- depth trees, each of 
whose levels are characterized by four language- universal parameters; feet 
are hounded or unbounded; the head of a foot is left- terminal, medial, or 
fight-terminal; and feet are eon strutted left- to- right or righMO-lefl (Halle 
and Vergnaud, 19-87)- For example, the English su-prasegmental stress pro 
cess would be described as: 

l.5yllarjL* hn^dg are the stress -hearing unit*, 

a. unmarked: heavy ultima ie inherent head. 

b.narktd: hfttvy syllabi* Is Inhe-ranr h»*d, 
2. Compute stress domains,, 
3. Perform phonetic adjustments. 



"Moiit, ire tl\t unite ot tylUble mi^ht; * htwy w [libit lu mere mora* ttin & light 
syHihLc. Twihnir+JIy, * mPT* if 1 Kgffl«lH dominated br tfce ijllibJe nucfottft, Q«m#n.te 
mi Kevser (3 8--BJ). . 



a, short en head of opan uord-medial nonhead syllabise. 
h.dastre-SB head adjacent to mora president head. 
c, reduce atraaalass vomj.9 tg shva. 

T:i.e assimilation -beafJJJg irnits of a- language are thoae nodes of the articula- 
tor? tree that ijitttact ^sLh asBimi] alien pr^es^-v ii-cltldirig harmonic and 
blocking features, Lons-dktance harmony corresponds to an unbound^ 
domain of assi mi Lotion.. A prototypical assimilation process might look [Ike: 

l.lrti culatory nad* n is the as similari an -hearing unit - 
a.as?isdlation and blocking jUaiures are inherent heads. 

2 -Compute assimilation donns.ir.E- 

3,Perforn phonetic adjustments. 

a .spread node n from head segment to its domain . 

The ram aj rung suprasegmencaJ priK<4MI axe also straightforward- For ex- 
ajHpfe, the melody plane represents the sejrmental, domain of (njui-tonaiiL}'. 
This is, of course, an informal propound intended Lo illuminate the fdalion- 
thip between the autosegmerita] processes and the segmental Siring, and to 
suggest a- formalization of autosegmental phonology. 
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Chapter 3 

Syntactic Agreement and 
Lexical Ambiguity 



lb this chapter, we consider the computational process of computing the lan- 
guage user's knowledge Of syntax, Knowledge of syntax includes knowledge 
of syntactic dependencies, such as agreement or selection,, and knowledge of 
purely syntactic distinctions, such as noun /verb 01 singular/ plural- Sytitac 
tic dependencies ire defined with respect to the syntactic distinctions. That 
is, we say "a verb selects a. noun phrase™ or H, tlL* noun and verb agree on 
number," An adequate linguistic theory mutt represent these dependencies 
and list the set of possible syntactic distinctions. 

By any Account, syntactic dependencies Me complex, involving the interac- 
tion of local and nonlocal relations, Seemingly local decisions, Such as the 
disambiguation Of a particular word, can have global consequences.. This 
suggests that It may be difficult to assign a structural description to a se- 
quence of ambiguous words. In order to translate this Id formal observation 
into a formal proof, we mast define the problem of assigning, * Structural 
description to a string of woids. 

We immediate! v en counter two difficulties. The first is thai no one under- 
stands what it means to successfully comprehend ail Utterance- As discussed 
in the introduction, it cannot mean to find exactly the structural description 
in the head of the speaker, because this may not be possible, Nor can it 
mean to find sonic structural description for the utterance, becau.se this is 
the trivial language miscomprehension problem. In short, it JS not possible 
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to define the LC problem for syntax without a simple characterization of 
the class of appropriate structural descriptions. In order to overrode this 
obstacle, we must define our problem So that h is a natural flubproblem of 
any reasonable statement of the language comprehension problem. 

The second; difficulty is that^ unlike the- anaphora problem considered In 
Chapter 4, the class of structural descriptions for syntax does not have a 
simple theory-invariant (that :*, direct) characterisation. There are a wide 
range of competing syntactic theories, and they differ .su^nifkantly. It is 
possible to broadly distinguish two classes of syntactic theories, 

• In unification- based theories, such a* lexical-functional grammar or 
generalized phrase structure gramma^ atomic features represent pos- 
sible distinctions. Syntactic dependencies are all stated in terms of 
one simple mechanism : the unification of uniform sets of features be- 
tween a phrase structure node and its immediate ancestor, children, 
or siblings. For example, subject-verb' agreement is implemented by a 
chain of local anirkation: the Subject noun js unified with the subject 
NP (ils ancestor); the Subject,, with the matrix VP (its sibling)^ and 
the matrix VP with the main verb (its child). 

• In current transformational theories, possible distinctions are repre- 
sented by features and morphemes. Syntactic dependencies consist- 
of particular linguistic relations, such as predication, selection, and 
theta-role assignment. They ace defined primarily in terms of local 
phrase structure configurations at different levels of representation. 
The mapping between different levels of representations is performed 
by transrormaticins. Fur example, suhjeft-verb agreement results be- 
cause the subject specifies the features of an agreement morpheme; this 
morpheme Is subsequently combined with the Verb mot morpheme at 
A different level of representatbll- 

In Order to overcome this obstacle erf competing theories and achieve an 
invariant analysis,, we mast first define the language comprehension problem 
for syntax relative to the b'ngaistic. theory, and then analyze its complexity 
for both classes of linguistic theories. 

Our subprohkm of choice is the lexical resolution problem (LRP) for a given 
syntactic theory: Given a partial syntactic cgpresentacion R that yield,* * 
string erf ambiguous or underspecified words t and a lexicon I containing 
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ambiguous, words. cart the words in R be found in the lexicon L*. This 
problem statement overcomes the two difficulties. It is defined relative to 
the syntactic theory and tlhe language user must solve the LRF in order to 
find ait appropriate structural description. 

Unification -based theories ax* very similar from a formal perspective. And 
because all syntactic dependencies are stated in terras of ft. simple, uniform 
mechanism (feature unification), it has been Straightforward to prove that 
the LRF for these theories is NF-hatd (Ristad and Berwick, IMS). In this 
chapter, we prove that the LRF for modem transformational theories is also 
NP-haid. Both proofs rely t>n the particular details of some linguistic theory. 
But the combined effect of these two results for the LRF is to argue for the 
NT-hardness of the "true" language comprehension problem for syntax. 

The chapter is organized into four section*. The first section introduces 
the structural descriptions of current transformational theories, with moti- 
vation, In section 3,2, we prove that the LRF is. NP-haxd for these theories, 
under a very abstract furmuiatiou, N T e!tt> section 3,3 shows exactly how this 
abstract formulation applies to the '^Barriers* theory of Chomsky (1&S6). 
The conclusion discusses the central role that locality plays in cransfoima- 
'.sonaj theories, and the consequences of allowi ug uniform mechanisms in the 
linguistic theory. 



3.1 Morp bo-syntactic depend nncies 

The syntactic structure underlying even extremely simple constructions can 
he quite intricate. Consider the simple passive expression (1). 

(1) John was seen, 

What is it that English speakers know about this expression? For one, they 
know that the expression describes an event that occurred in the past- This 
information is contained in the verb ma.t, which is overtly inflected for the 
past tense as well as overtly agreeing with the surface subject on number- 
One way to represent this knowledge is to say that: the overt form v-.ii- 
underlying] y consists of the three morphemes [be], [past], and [singular]. 

English speakers also kno>w that the expression is in the passive voice— that 
the overt subject John is subjected to the 4l seeine; action, 1 ' and therefore 



43 






KP A E rl 

I 

J ii An . 



A-rt T*s*#P 

I 
) ■=■ ij;iiIh. 



'., /\ 



I 



r'tiL 



Aiprcc VaictP 

I 
*f 

Vwti VK" 



[passive) r ^s 

V N"P 

I I 

HC t r 



Figure 3-1: The underling (partial) structural dwcriptkstj at JeH was sttn. 



stands in the same relation to the verb sec in (1) as it does in the corre- 
sponding active expression .Someone sou: Jafiti. That i^ fi) the verbal form 
s«n consist of the (he verb root (a**] and the voice morpheme [passive^ 
which happens to be realized as the +*ri suffix here, and [it) John is. the 
underlying direct Object of the verjj .*nr in both active and passive variants 
of theespression. 

In order to represent this knowledge that language users in. fact have about 
suets expressions, we assign the partial structural description depicted u 
figure 3.1 to the ntterwict (1), where each 9urfa*e word has he™ exploded 
into jIs underlying [nurpiLCTJies. 

The morphemes are organised hierarchically according fro X-bar theory. X- 
bar theory states that morphemes of Lyp*> X project into syntactic con- 
Stitiients of type X. Tha-t is simply to say., for example, that a verb phrase 
must tontaja a verb and a noun phrase must contain a noun. The relation 
h-efween a morpheme X and its complement (a phrase YP) is represented by 
I he sisterbo&d configuration inside the first projection of X {2}. 
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Selection in an instance of complementation. For eKHuple, the Aspect mor- 
pheme [be' selects the voice morpheme [passive], which accounts fur the 
deviano' nf the minimally different expression John was ste. 

The relation between the first projection <jf X and its specifier {a phrase YP) 
is represented by sisterhood in the second projection of X (3 J. 



(3) ? 




YP Xl 



The second projection X2 of the. morpheme X i-s a phrase of type X, also writ- 
ten XP, Agreement is an instance of specification. For example. the proper 
Dann Jfonn specifies the agreement morpheme [singular] in the underlying 
struct nraJ description in figure 3.1. 

Finally the underlying thematic relation between the verh tftffl and John is 
represented indirectly, by postulating a trace i; that is selected by the verb 
see (a trace is a phonolopcally silent place-holder) and Ls assigned the same 
index as element whose place It is holdine; (Jf&riy). 

In assigning this representation to the utterance.' [',), we were guided by the 
principle of universal explanation (UEJ. l"E states that there is only one 
uuderlyineilanpjaeje, from tvhich particular languages differ in trivial way J. 1 
One consequence of t : E Is that if any Language males au overt distinction, 
then all languages must maie that distinction in their underlyingly repre- 
sentations- For example, In. languages such as Hindi, verbs agree wiih the]? 
direct object and their subjects (Matlfcjan ISSU); therefore object and Sub' 
ject must both appear in the specifier position of agreement phrases in all 

L T1>£ pttnriple al outran] explanation 19 * jMftkutkr theory vS what TOnutjtUHis ant- 
vetnaJ gtitnwiar, dial ia t a theery of tins in n».ic endowment at \.hi lan«uag,« us^r It is 
f'JBd imiftn ta.1 In ihr: Rtudy rjf language, tbi hialzrkal ^amflpk, «« th* influential vmjtIc 
ot J*mci Hsaiti* (JTfi-S), tjpecL&llj- hia andyHui of i«BW. And in his Award,- winning 3627 
eiw** toti. Irli; ynrin ot lAhglttt^e, JohuiTl Gottfrifd van Kenier m^ "^WIid can fwh&lFver. 
n* roty hsxr. to siy iipon, tli* subject) entirely den;; th*" fuiriUmtn'U] CCHIMe&M, CJCi^i- 
Lp.r. between matt Im p^iRiM;? There ■■ but aoe human rat* upon the <MTtll, *fid bit one 
linguait." (p.tJJ) ,.. 
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languages. t \ second consequence of UE LS that idl clauses have the Same 
underlying structure. At the very least, a clause must contain a subject, & 
tense, and a verb. And b*c*use it contains a subject, it must also contain 
an agreement morpheme. 

We were also guided by the goal of representing UnEmistic relations uniformly, 
via local phrase structure configurations. Sn the selection relation between 
a. verb V and its underlying direct object XP ii always, represented by the 
complement configuration ™( V1 V XK]." n And when '.he direct otaject appears 
as the surface subject, as in the passive., a trace is used as. a plitce-hddeT. 

Now consider the evpressiori ('4). 
1.1) Tom saw Mary yesterday. 

if vw examined certain cross-linguistic facts, and obeyed the principle of 

universal explanation, we would assign the underlying structural description 
in figure 3,2 to this expression, 

The verb sec selects, the proper noun Marias its direct object, resulting in a. 
VI projection, This Vl predicate is specified by its subject, the proper noun 
Tom. The relation of modification between the resulting VP and the adverb 
yesterday is represented configuration ally as ad junction to VP. The remain- 
ing morphemes — object agreement, verba] tense, and subject agreement— 
appear In this structural description, but have not yet been specified. This 
is. indicated by the empty categories "■[*]•' Jn their specifier positions. ^C 11 is 
the complemefltiier morpheme, which is phojUjIi^irOy mils in declarative 
expressions. 

The underlying representation in figure 3.2 undergoes certain movement 
transformations, resulting in the surface form in figure 3.3, 

First, the underlying object jtfsrp moves to the Specifier position of the 
object agreement phrast, so trial the agreement morpheme will he specified 
[singular] and so that the object Mary will be assigned objective case. NeKt 
Ibrn n the underlying subject of the verbal predicate [see. Afary], moves to the 
specifier position of the subject affluent phrase, in Order to specify the 
agreement morpheme as ^singular] and be assigned nominative case. Finally, 
the verb Kg combines- first with the object agreement morpheme, then with 
the tense morpheme, and finally with the subject agreement morpheme. Ir is. 
spelled out as sa Wl Each movement transformation leaves behind an indexed 
trace. 
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TUi analysis- is motivated by Chomsky (l°oS;19S9) and Pollack (19SB). The 
movement transformations proposed in that work arc considerably mora 
com plex t han those shown here. 

Sy explicitly representing the dependencies between the morpheme* in this 
fashion, a number of things become dear. For one. each morpheme typically 
interacts with Only a few other morphemes, such as its specifier and its 
complement. However, because each word consists- of several morphemes, 
every word interacts with every other word ill a clause. 

Reconsider oitr first example (1). In that example, the passive verb form 
scc+cn. selects the underlying object f] and assigns it » 'patient' thematic 
tole. The underlying object li appears as the surface subject Mm\ the 
subject agrees with the inflected aspect te+jM^+aanfftJar, which assigns it 
nominative case;, and, to complete the circle of interaction*, the inflected 
aspect was selects the passive verb form. These properties of worda. such 
as tase'fis&rJiingf thematic Tole assignment,, selection ami agreement, are all 
independent, not directly deducible from the ph onologkal form of the words, 
and potentially correlated in the lexicon. 

It is easy to see that interactions among the words, in a sentence can become 
extremely complex. Imagine that the lexicon contained three hemophonou* 
verbs — sfifi, *efii k and mcj— with the same phonological form but different 
ielectional restrictions- Then verb phrases could encode satisfied 3- CNF 
clauses: kcj would be false and select a true subject; seej would be false 
and select a true object; and see^ would be true and select * subject and 
■>'■■; i-..-i .,":. 1 ■. 1-1T. v.ili '■. '['!■' 1 : 1 1 - :• :| 1 .-.■ 1 ■:•: is ;hat any verb phrase I . eaded 
hy see must contain a word representing a true literal- We could even get 
two literals Of the same variable to a^ree on their truth ^alues by moving one 
to the subject position of the other, where they must agree, exactly ae In the 
passive construction; the underlying object moves to the subject position, 
where it must agree with the auxiliary verb. Then if words; were Boolean 
literals, jt would be possible to encode liSAT instances in sentences. The 
proof in the next section formalizes this intuitive argument. 

So far our discussion of the language user 1 * knowledge of syntax has concen- 
trated on knowledge of syntactic dependencies. Let US therefore conclude 
this section -with a brief discussion of the range of possible syntactic distinc- 
tions. There are two broad classes of distinctions with syntactic effect^ the 
purely syntactic and the semantic or pragmatic 
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Many semantic and pragmatic distinctions — such as aiaimate/majumate or 
abstract/concrete have syntactic affects. As Chomsky (1966:7511) has ob- 
served, this can be used to account for the dc-viancy of certain expressions, 
For eJCBunplej. the contrast b^t'wrra sincerity may frighten the toy and tht 
ft*jf fflajr frighten anczrily is accounted for by the fact that /rcjfi (en elects 
animate objects. 

Purely syntaclj!: distinctions are those distinctions that arc independent of 
meaningful eKtra-linguislic distinctions.. 2 For e-Kimple, the syntactic dis- 
tinction among masculine feminine, and deuter does not correspond to bi- 
ological :,■■■<. nor -lo<:= i\rnr.\ ar/;."i:r;i; t.::o? p oi: 1 1 :•.■ ->'\v-\r;C or perceptual 
indi visibility. Nor do nouns denote things., or verbs, actions, as has been 
Very wittily ajgued by Thomas Gimtet Browne in 179*. This cLa&S of purely 
syntactic d istinc tions- includes murphcme class (noun F verb, adjective, and so 
forth), to-called agreement features {gender, a umber, person, kinship class,, 
etc), case, grammatical function, thematic role, and so on. These distinc- 
tions vwy from language to language,, and are all treated uniformly by the 
linguistic tli-eoiy. Syntactic distinctions appear to originate from semantic 
distinctions, but soon lose- their connection to meaning. If this is so, a.s 
nnguists have signed it is, then we have good reason (a believe t|-.a', the 
number of syntactic distinctions is unbounded in principle. limited only by 
the amount of time it takes the Language user to acquire a new distinction, 



3.2 Complexity of linguistic transforms 

In this section we prove that the LRP for modern transformational theories is 
NP-hard. The idea of the proof is quite similar to the proofs of temma 2.2.1 
and theorem 5 above. As in those proofs, we will construe: a ; t r.i ct i: t ;i .'. 
description that enforces the 3SAT constraints. Ambiguous words will play 
the role of elliptical speech- The words in the Structural description will be 
ambiguous with respect to a syntactic distinction that corresponds to truth 
Value. 

Recall that transformation theories postulate at least two levels of syntactic 
representation— tilt underlying and surface representations— and a mapping 
from underlying form to surface form. The underlying form is tailed the D- 

Tb* dffaftkM <oi wt«i ii uid isn't n. aynttctic dislincuon. in o[ cauraf niliiety lleoiy- 
Latnn»|. Howtiwr much 46 Iteie is asy agM#»«iE. syntax Includes tbaL portion dI Lin- 
SukUf fotni lJi*t ii logically LadEpendftnt of l*nJ-™cnld meaning pr phanolanj. 
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Structure (DS} and tike surface form is called the S-Structure (SS). DS is 
a, representation of thematic W&B assignments selection, and grammatical 
function (subject, object, etc.). SS is a the syntactic representation closest 
to the surface form of a- sentence. In current transformational theories, DS 
is mapped onto SS by the geriC-ralJ *«d move-o- transformation. 

The idea of the proof is to simulate the 3SAT constraints writh & comply 
syntactic representation, that we will build using one simple buiiding block, 
called a u 5tair," 
Definition . A siair is an underlying form U-t with the following structiue: 

1. Remmve sdnctore. t/, contains another stair Ui+i- 

2. Selection and agreement ore e&tre.!aled. Ui contains a morpheme fa 
that selects £ r , + ir local affixation rules will morphologically merge 
the head of E7, with the mi>rnhinme jj,, thereby correlating selections! 
properties of pa with the agreement features of Ui in the lexicon. 

3. Undergoes otfrjaffli^ movement. Ui selects and assigns a theta-fote 
to Ui+i. hut does not assign it c:ase. Therefore (/ 1+1 is a proper Jy 
goYetaed argument that undergoes obligatory movc-mem iji order to 
satisfy the case filter. (The same will he true for U,-) 

4. T™nsparemf to extraction, U, allows nodes that can be moved out 
of Ui + i to also he moved oat of Ui. (This kind of long movement is 
typically done by successive cyclic movement between bounding nodes 
in order to satisfy the subjaceny condition of bounding theory.) 

5- Contains a landing site, b\ contains a specifier position that is assigned 
CISC. The head of Ui will agree With its specifier; therefore only Stairs 
that agree with the head of Uj can be moved to this specifier position. 
(Correspondingly, this means that Ui can only move to the specifier 
position of a stair U : , J < t, that agrees wjth it. J 

Recall the 3SAT constraints Oil page $5: (i) negation: a variable xj and 
its negation Tj have opposite truth values; ("} clausal satisfaction:, every 
clause C, = (m V fo V a} contains a true literal (a literal is a variable or its 
negation); fiii) consistency of truth assignments: every positive literal oi a 
given variable is assigned the S4m.e truth value, either 1 or 0, 

Lemma 4-2*1 Stairs can enforce the SSAf constraint*. 
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Proof. The idea of the proof is Its represent negation as a morpheme^ to en- 
code the truth values of variables in syntactic features; to enforce clausal sat- 
isfaction in the underlying representation (DS),, using selectlonal constraints; 

,i:nl :ii ;-i .u:l- consistency of truth „■■,<..:-_• -i ts to the surface nep rcsenta:L on 

(55 ) L using long distance movement and specifier-head agreement. 

The DS consists of one staJr per formula literal, which is three stairs per 
formula clause, Let the clause Q = (a,- vi>; va) he represented by the three 
stairs t r i,*> £ r q,s a-ad # 1je : 

(S) 




Tin.- selectional constraints of the three stairs ensure that each 3-clause con- 
tains at least one true literal, although lexical ambiguity wilt prevent us 
frrtm knowing, which literals m the 3-tlause are true. To do this, the first 
stair Ui# must promise to make C; true, either by being true itself or by 
selecting a Stair U^ that promises to make the 3-clause true; to fulfill its 
premise., the second stair Ui,t must either he ttac. or Select a true stair £ r lir . 
(If £. r p, H is true, it selects the next stair U^ with either truth value.) Thla 
chajri of selectional dependencies is shown in (c). 

(6) --ft. tnt 
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Affixes listed in the lexicon w]]] negate cr preserve vail sJ>[e truth values,, ac- 
cording to whether the corresponding formula literal is negative or positive. 

Then, scanning from right to left, each stair is moved to the specifier position 
of the closest stair of the same variable, either hy long movement Of by 
successive cyclic movement (se* figures 3-5, 3,0), 

In the resulting. SS, the specifier position of the stair that corresponds to 
ith otcurrence of A given variable contSHJis the stair that corresponds to the 




Figure 3.4: On the input 3SAT instance / = (*] ,^a r *j), (Ti, Ea, xa) , the DS in 
the figure is created to represent /■ tach liter a] in / is represent™} hy a sLaii 
construction. For example, the first literal of the first cIwik, *! n b represented by 
the outermost stair ooristrLicLiGn, J7 Lj . SJefetticmat constraints are enforced, at DS. 
Thfty ensure that ever) 1 Boolean clause -contains a true literal. 



i + 1th o-tenrrente of the Kacne Variable, These two stairs agree with each 
other by specifier-head agreement, Now aii the stair* the correspond to 
literals of a given variable arc contained in the specifier position of the stair 
that corresponds to first occurrence of that variable (see figure 3.C). 

Now all variable* hive consistent truth assignments., by specifier-head Agree- 
ment at SS- All clauses contain a true literal by DS selection. Negation, is 
performed by affixes. The formula, is salifiable if and only if the correspond ■■ 
lag DS and SS are wll- formed, □ 

Using the onn&trnction in lemma 3-2. 1, and the fact that words may be am- 
biguous, we tan now prove the following theorem about the lexical resolution 
problem: 

Theorem fl 7'fti? LHP is NP-hanl in models Uutt permit a ffiair. 

Proof. By reduction to 35 AT. The input is a Boolean formula / in 3-CNF> 
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Figure 3-5: This- fig utt depicts the tlrst movement tT&nsformation thai is applied 
in the jnappsng of the DS in figure 3.^ to itn: SS in figure 3.rj. The innermost sLjiji 
(t- r i.c representine; the last ]Lteira.l In /) nv^vcB to the specifier pinion of the third 
*!«ir (t^,,), leaving behind * trace t 7i . This movement tranflTuormaLiofn relates the 
2 a literal of the second En-nlcaD dauae to trie x 3 literal of the first Boolean clause. 
New bolh stairs agree, by specifier-head agreement; ttierrfore. the corresponding 
literals a{ the formula variable x 3 will be assigned, the same truth value, even though 
they appear m different claua«. 




Figure A.fi- This hguie shows the SS that results from repsatedlj* applyiag m D v^ 
mem tianafc-j3:i aiians to the DS depicted in figure 3.4. Spectfier-hend agreement 
■x enforced at SS. It ensures, that aJJ instances nf a variable air aEBigned the same 
truth value. 
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the output ia a lexicon L and a structure S containing ntlderapedfied words 
such that the words iil 5 (an oe found In L if Aild only if / is satisfiafale. 
The structure 5 will be built from / ^cording to the Stair construction in 
lemma 3,2.1. Two Stairs will agree if and only If they correspond to literals 
of the same variable and h*ve been assigned tin. 1 ! same tiuth \-alue. The 
words in tbe syntactic structure will he ambiguous only in the syntactic 
distinction thfct corresponds to truth value- One agreement feature encodes 
variable truth MSLgnments.,, arid another identifies Boolean rariabks. One 
non -agreement feature encodes literal truth valuer and A second one keeps 
track of the promise in the chain of selection*] dependencies shown, in (ft). 
The stair construction ensures that the, IS AT constraints aje- satisfied by all 
permissible lexical choices fur the *'Otd.S- I I 



3.3 Complexity of agreement interactions 

A central -question for current transformational thcoties of syntax, such as 
Chomsky (1986) and Laanik and Salto (1984), is what are the consequences 
of Interacting agreement relations, such as specinerhearf agreement, head- 
head agreement* head'projettion agreement > and tbe various forms of chain 
agreement (link, extension L composition)? 

In this section, we reduce this broad question to the narrow question! can 
these transformational theories simulate the Stair? If yea, then we have 
proved that the LRF for those theories is NP-hard. This,, in turn, will give 
us reason to believe that the interaction of agreement relations can be quite 
complex in these models, 

Lemma .1.3.1 Ha.rrif.vs alUi\i:* a fliair. 

Proof, The noun complement structure depicted in ne;u:e 3.7 is a stair 
according to the Barriers model of Chomsky (l&Sft), {The definition of a 
s'.air appears on page SI.) 

L Recursive, -ttrvjcture. NP< contains NFy+i, the next Stair. 

1. Selection and agreement are correlated, NP» contains a verbal mor- 
pheme VO that selerts KP l + [ . Vfl undergo^ obligatory head move 
men! to tbe inflectional element 10, treating au inflected verb In the 
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Figure $.7: A stair eonstiuttiwi few Lite Bwriers mode] oF Cliumalcy (1^A§), This 
ii the phrase AtHitlure thai wonuld be assigned to npoin TOmpLcment tdnatructiiMiB, 
»Hch jb desirt t& tint plates. 



head of IP, The ^feaEnres w'dl appear on the inflected verb by speciiier- 
Jtead agreement, where they may be system atically correlated with the 
Verb's selecttonal properties in the lexicon, 

1 Undertjrx .s obligatory mfiutrntTit. VO selects and assigns 4 theta-iole to 
NPi-Mn but does not assign it case. Therefore NP 1+1 must move. This 
is possible ]f VO bis lost Its ability to assign case (passive mor phology ) 
or if NF a+ i is the underlying subject of VF*, &S La currently popular 
VP-interna3 subjec t analyses, 

4, TpantpQtr-nt to cziractioti. In Barriers,, blocking categories (BCs) stop 
unbounded application of move- or. Iofaroialty, a BC is a category not 
tbeta-marked by a lexical XQ. Fbr eHimple f matrix verb phrases- are 
BCs because they are selected by the nonienkal Category ID (in flec- 
tion) Vfitbotit being assigned a theta-role- Unbounded A-movemeiit 
becomes possible when a category is mo^ed [&czi steps, adjoining ty 
intermediate nonarjriiment petit-lOTis before moving OB (adjunction is 
typically to 3C§). 

Incur noun complement construction (figuie 3.7} t [S"P; +J can he moved 
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dtiit. of NPd, Vf i& a DC and a barrier for NF1+1 because it is flOt L- 
marked, but KP^ can adjoin to the nonargument VF and vnjd its 
barriGfbood because nonaieunnsitls may be freely adjoined to. Both 
NP( and IP, arc L- marked, and therefore are neither BC& nor barri- 
ers for further NP f+1 raking. Thus, NF|.+i can be A- moved to any 
c-ccmmanding speclfier-of-lP position [e] without violating the ECP 
becan&e all traces are propcrLy gtivrjitwd (both theta-covermad by the 
verb V that select NPf+i.. aria^-marked (antecedent-governed) by the 
deleted trace adjoined to VP). 

Rjeinhait (pc) suggests a. similar albeit rtiaJginal,. isaturaJ example 
where an ftp containing an argument Eiate is topkallacd to GP spec- 
ifier from an L-marked position: 

(Yl 

* J a, ?[What burning ti+j], did John say [of what book] 1+ i [ti would 

be maguiftcerit] 
b, [what burning); did John say [{(, of what book] would hemi^- 
ntflcent] 

Cli:ii' '-,■■ I ;:■ ) hi.:g^fts:? Mi.i1 tin. pf pi.'- ;v il" I: ::f ".' > ':■ .':■'!. .: '. • '. )'.-.., ' 

a better topicaliaation example as (BJ. 

(8) What burping did John say (that) of that book. Mary thought 
wonld be magnificent- 

5. Contains a la7niirt$ site,. The internal IP, contains a specifier position 
("landing site) that will agree with 10 by specifier- head agreement in 
nonlexicai categories; the specifier position will abu agree with frO (the 
head of NP,) T by predication. Alternately, head movement from VO to 
fG to NO can cieate an inflected noun ,L [[V I] N]* in the XO position 
of NPf that will agree with the landing site. Although it is difficult 
to find a natural example of SU.cn an inflected noun> no arguments 
or analyses exclude it in principle. A close natural example is noun 
incorporation In Mohawk verbs (Baker 1^&5;13!5). 

This; establishes- tbat the noun complement construct jon in figure 3.7 is. a 
stair in the Binders model- [J~ 

Theorem T The LRF is NP-kard in Barriers model. 



Proof. The proof follows from lemma 3.3-1 and theorem 6 above. The 
lexicon contains ambiguous inflected nouns ''[[V Ij N]" that have undergone 
verbal incorporation, [ 

Ristad (13S&:22-28) contains a direct proof of this theorem 7, with all the 
details, expb'citly worked out. 

Theorem S The LRP is WP-hard in the LasnikSaito modd. 

Proof. The preceding proof proceeds without alteration in the L&snik-Saito 
(19$^} model because in that mode], theta-gcvcrament suffices for proper 
government,, and traces may be ddilted after f-maiking. □ 

How might- we change the Barriers model in order to block the preceding 
reduction? 

The preceding proof relies on long movement of the NP complement of a 
verb {in a mmm complement construction}, which is precisely what Barriers 
strives to prevent by reducing proper government to antecedent £Ovi.t:l:::c-:l: . 
using the Lasnik-Saito ?- marking mechanism. {The commitment to elimi- 
nate theta-government from the definition of proper government is- tentative 
at best. The Strongest position taken is ' l Po*sibly ( a verb does not property 
govern its 0-marked complement,'* p.79.) In the Barriers stair construction, 
ml argument undergoes long movement hy adjoining the argument NP to 
VP> 7-marking its trace,, and then deleting the intermediate j4'-trace at LF. 

This is the enact derivational sequence (adjoin, -y-marfrf, delete adjoined 
trace) used in Barriers (pp.2 1-32) to move a wh-suhjett from a t het a.- marked 
CP complement to a specifier of CF, provided the wh-phrase is licensed at 
LF. Barriers attempts to exclude similar long movement of an NF from a 
similar (but caselessj subject position by appeal to Binding Theory condition 
C at S- structure: the NF trace in Subject position would be an X '-bound 
R-expression A- hound in the domain of the head its chain (p.93, fn.30). 
(Barrier* differentiates the two construe tioos solely hy the nature of their 
traces; wh-traces are not R- expressions, while NP-traces are.) 

Crucially, condition C will exclude long movement of NFs Only if trace dele- 
tion is restricted to LF. Otherwise, adJHWned traces could be deleted before 
canaing an S-stmctLre binding violation. But trace deletion cannot fee re- 
stricted solely to LF. If i'. w<?re. then any ECP violation treaty by LF- 
movftment may be avoided, simply by deleting offending intermediate traces 
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after they have done their t marking duty, This can be done because ad- 
join.*! d'-traces are not lequired by tie extended projection principle al LI", 
This is why neither Barriers nor Lasnik-Saito in fact restrict trace- deletion 
to LF- Therefore, Jong movement of an KP is nol excluded in the*C modelfl, 

There is another conundrum. The long movement used in the proof is 
applied cyclically, so that til* trace of the argument NP is no longer c- 
comjnanded by the argument NP once all movement has applied, and hence 
is not A -bound by the head of its chain at S»structure. This violates the 
c-command condition oil chain links, but such violations are standardly ig- 
nored in the literature, and therefore do not raise any special problems 
here- Stf uxtures where aucb violations- are ignored include the Sopicallza- 
tion example {7) above, antecedent-contained ellipsis (9a) and passive VP 
topicaliaation in EngliHh (&b). 

^ J a, [Everyone that Max want* to e a j 3 John will [kiss ei': 2 
h, [[vp Arrested ti by the FBI], John, has- never been t 3 ] 

Finally, even if trace deletion were disallowed entirety, long movement would 
Still he possible from theta-marbed noun complements, and the proof of 
lemma 3.3.1 would proceed, because theta-government cannot he eliminated 
without negative consequences In the rest of the theory. 

Proper government can be reduced to antecedent government only if an- 
tecedent government suffices for NP- movement (eg., passive and raising) in 
accordance with the chain extens]on operation, This fails her.ause only the 
terminus of an (extended) A- thai HI may theta-mart or case-maik t in order 
to obtain the CED effect (Condition on Extraction Domain*, see Barriers, 
p. 72). Therefore, in passive construction?, where the A-chain headed by the 
subject NP must be extended lo include the verb and inflection and thereby 
achieve antecedent government of the NP-ttMe at S-stnjctnre t the inflection 
will simultaneously loose its ahjljty to case-mark the subject position, The 
direct consequence is that both passives in (10) violate the case filter and are 
ungTammatfcal in Barriers without theta-governmenl., although only (lOnJ 
should be excluded, 

a "*|ej was killed John 
b, John was. killed t 

In short, the chaip extension required to satisfy the ECP without thcta- 
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government will prevent the subject tv'P from receiving case, and thereby 
violate the case filler, This Optn problem may he remedied by abandoning 
either fi) the case filter, which would without question be disastrous for 
the theory^ (it) the Barriers analysis of CED effects, which would reduce 
empirics] coverage,. Or (iii) the coinde)dng/cha]n extension analysis of NP- 
uiovemint, which will have Lire direct consequence that proper government 
cannot he reduced to antecedent government. 

The possibility -of long distance argument movement hy adjunction to inter- 
mediate positions remains in more recent proposals based on the Barriers 
model, One such proposal, due to Chomsky (!&£&}, is that derivations be 
subject to a "least effort principle™ with the following provisos, LF per- 
mits only the following five elements: at gu merits, adjuncts, lexical elements, 
predicates, and operator-variable constructions. Affect-alpha must apply at 
LF to each illegitimate object to yield one of these five legitimate elements. 
Chomsky (i3B&:63) urges ua to "consider saccessive-cyclic A' bar movement 
from an argument position. This will yield a chain that is not a legitimate 
object:; it is a 'heterogeneous chain, ; consisting of an adjunct chain and an 
[A-bar, A} pair fan operator- variable construction, where the A-bar position 
is occupied by a trace]. This heterogeneous chain can become a legitimate 
object, namely a genuine operator- variable construction, only by eliminating 
intermediate A-bar traces. We Conclude, then, that these must be deleted 
at the point where we reach LF representation." 

A direct consequence of this theory, then, is that successive-cyclic A-bar 
movement from a theta-marked argument position to a Case-marked argib 
ment position will also yield an illegitimate object, that can become a le- 
gitimate oh jec:l, nameiy an A-cham, only by eliminating intermediate A-bar 
traces at the point where we reach LF {that is, before LF chain conditions 
apply). We conclude, then, that these intermediate traces must be deleted 
at that point, and that long distance NP movement is permitted by the 
theory, 



3*4 Conclusions 

3.4.1 Locality in linguistic theory 

The guiding idea behind transformational theories is to map each linguistic 
relation R{ x>y) into a local phrase structure configuration at some level of 
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representation. When this is not possible, because r and y are not proximate 
at any level of representation L tlisn Ike relation R[x, jf} must be broken ]ntO 
a chain of local relations R{ x. , 1 1 },R.(t 1 , f^)*, ■ -,R(tmV) using intermediate 
elements k. 

Locality in linguistic representation! is a way to describe complex intfnu- 
tjon? with intervening dements, When a nonlocal relu-tion J?(#,j) is broken 
into a chain of local relations, then an element z that is on the path between 
x and y tail affect the n-onlocal relation > by interacting with one of the inter- 
mediate positions in the chain, of local relation*. For example, move- a IS an 
operation that induces a ^'movement" relation between the moved element 
and its trace. This operation is constrained by subjacercy and hy the EC P. 
A* A consequence, unbounded chain dependencies can arise only from suc- 
cessive cyclic movement., which constructs intermediate traces- [f some step 
of the movement is. blocked, as when an intermediate landing, site is filled or 
there is a barrier to movement, then the nonlocal movement tfependenfy is 
blacked. 

Locality, then h is only a constraint on the way relations are described. Any 
nonlocal relation can always he riescijherl as a chain of local relations. In 
fact, all recursively enumerable sets have local descriptions by definition* 
because the idea of an ""effective procedure 1 " is one that consists entirely of 
simple local Operations | too elementary to b* further i.|nr.oi;ip<>s«il {Turing, 
1036] Minsky, 19CIS). In short, "locality 1 " has no empirical consequences and 
cannot be falsified- 

Of course, a particular linguistic constraint, that happens to be stated in 
terms of local configurations, can always be called a ""locality constraint."" 
And particular constraints max-- in fact be falstfahl*. However . noempiri-rjij 
evidence can distinguish the way in which a constraint is stated, that is, 
in terms of local or nonioca] ennfigu radons, and therefore "■locality* is not 
itself a source of constraint, 

A case in point is the intermediate traces of Barriers-type theories, whose 
only apparent purpose is to allow the iterated local description of nonlocal 
movement relations. Intermediate traces result from a particular conception 
of the ECP as- alocal bound on move-a, There i* no direct p mpirica! evidence 
for the existence of intermediate traces. Nor is there indirect evidence* 
simply because they do not interact with other components of the crammar. 
For example, they might h*ve binding Or phonol ogital effects. Adjunct 
traces may satisfy the ECr only via antecedent government at L Ft as a 
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consequence, adjunct extraction results in Intermediate traces Eh at may not 
be deleted at SS. Thus, ihe only intermediate traces, required at SS are 
tie Mace* of adjunct extraction, but these non-case-marked trace* do not 

block imji(+(o -* timnna con t ractinci , which is -only blocked by ease-marked 
elements (C3Lom.sk>- 19ftfrlG2). For example: 

( 11 ) How do you wanna solve the problem? 

As expected, the intermediate traces in tp*dJier of CF and adjoined to VP 
do not block phonological contraction. Hither do these intermediate A'- 
tfaCes affect hi n ding relations, whose domain is NPs in A-positions-i 

(12) [which woman], did John [ vr . dream f fJE » (f jjp Bill [ 10 [ VP i] 
[VP BiW { * Wlf } [pp Witk *™ 

The governing category of the direct. object is \? (the complete functional 
complex), and therefore ths c-commMlding trace t] adjoined to VP couid 
bind the anaphof in object position within 3 La governing category, if the trace 
Were in an Apposition. But., as expected, herself is in fact unbound, which 
strongly suggests that t] is only relevant to the computation of nonlocal 4'. 
movement as constrained by the EC P. The precise formulation of the ECP, 
and the existence of the intermediate traces it requires, is the topic of much 
active research and debate. But the fact that these intermediate traces do 
not enter into Other syntactic relations casts doubt On their explicit syntactic 
representation, at least in my mind. 

Finally, locality has no logical relation to explanatory adequacy. The linguis- 
tic theory tii at best satisfies the locality requirement is generalized phra.se 
Structure grammar, la GPSG, a|| linguistic relations are reduced to maxi- 
mally local relations between mother and daughter, or among sisters. Rela- 
tions may extend beyond immediate domination only by iteration,, whether 
from lexical head to its projections, or from gap to filler In a unbounded 
dependency relation. Because all relations are uniformly- represented in syn- 
tactic categories, many forma] devices may interact in constraining the dis- 
tribution of a given linguistic relation. This, when coupled with the iteration 
of local relations to achieve nonlocal effects, can lead to severe computational 
intractability the universal recognition problem fur GPSfts ran r.*kc more 
than exponential time (Ristad, lSRfi). Moie importantly, there are infinitely 
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many unnatural GPSG languages, including fi Elite, regular, and context- free 
languages. Thus, the linguistic theory that most closely satisfies the locality 
requirement lacks both computational constraint and explan atorj' adequacy. 

The mapping of linguistic relations onto local configurations must therefore 
be justified i]L the same way that descriptions ate, by criteria such as ele- 
gance, perspecujty, and expressive power. Lncality does not always reS-tilt 
in elegant linguistic representations; nor can ill interactions be naturally 
modeled in this manner. 

fron local relations are broken into a thaill of local relations in order to ex- 
plain potential Interactions with intervening elements. When there are nu 
actual interactions, the resulting representations are inelegant, containing 
-,ij.:it"i:,>i-. intermediate elements, A uniform bound on the domain r>1 w 
lations, as in Koster (15-S7), will allow too many potential interactions that 
won't occur. More seriously, as shown l>y the constructions in this chapter, 
it is difficult to prevent undesirable interactions from occurring in such a 
system of representation, (The alternative is a relativized hdufld on the 
domain, that models all and only the actual interactions with intervening 
elements. But this is identical in conception to a nonlocal relation, antithet- 
ical ki luiidln l 

Not all interactions can be naturally described in terms of loeal configura- 
tions, For example, a linguistic relation that depends, on elements oulsjde 
its domain cannot modeled via local interaction TI-im transitive relations of 
cbriation, arising from the binding' theory, have nonlocal effect; on relations 
of antecedence, and these lutc-racticms are not naturally modeled in terms, of 
local eon figurations . 

3^2 The search for uniform mechanisms 

The pursuit of general mechanisms for linguistic theory — such as feature 
unification , the uniform local decomposition of linguistic relations, or the 
roindexing mechanism of Barrier* — has repeatedly proven treacherous in 

the Study Of language. Tt distracts the attention ami L-ffOrts of the field 
from the particular details of human language, that is, what are the true 
rep resent ^t ions, constraints, and processes of human language. 

General mechanisms have also invariably resulted in unnatural intractabil- 
ity, that is. intractability due to the general mechanisms nf the theory rather 
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than the particular Structure of human language, This is because do one 
mechanism haa been able model all I he particular properties of human lan- 
guage unless it is tie unrestricted mechanism. However, the unrestricted 
mechanism can also model unnatural properties, including computationally 
Complex ones. 

In segmental phonology, rules are needed to insert, delete, and transpose 
segments, Rules are also rubied to perform arbitrary Substitutions „ as in the 
case of irregular forms. Therefore, we conclude that phonological rewriting 
rules must be completely unrestricted. However, this Is a false conclusion . 
because we have entirely ignored the possible interactions between rules. In 
an unrestricted rewriting system, each rule applies to the derivation string 
in a Markovtan fashion, entirely oblivious *o the previous rules that have 
applied. But in a phonological system this, is not the case. A phonological 
rule Cannot delete a segment that was inserted by another rudef inserted 
segments are never rewritten and then deleted, ^or can arbitrary segmental 
Strings, be arbitrarily rewritten: irregular forms may only be rewritten at 
the interface between morphology and phonology, where all morphemeR are 
rewritten as segmental strings. 

In current syntactic theories, many different types of agreement are used, 
including Specifier- head agreement , head-complement agreement (selection), 
held- head agreement, head- projection agreement, and the various forms of 
chain agreement (link, extension, composition J. Therefore, we conclude, all 
agreement may be ftubsumed under the most general agreement mechanism., 
either feature unification (as in GFSG/LFG) or the coindexing operation (as 
in Barriers). However this conclusion invariably leads to unnatural analyses. 
Specifier-head agreement includes the relations of morphological specifica- 
tion and of predication, which is the saturation of an external theta-rcle. 
Head complement agreement includes selection relation, which is sensitive 
to an entirely d liferent set of syntactic distinctions than morphological Spec- 
ification is. So, for example, the agreement morpheme represents certain 
distinctions— such as person, gender, or number— that selection is not sen- 
sitive to. at least in Kiigiish. English verbs do not select plural objects, al- 
though they aie morphologically marked for the plurality of their subjects. 
The assignment of theta-roles is L'kc^ise insensitive to number, person, or 
eendei. When all these particular forms, of agreement are subsumed under 
one general mechanism h whether it be unification or coindesing, unnatu- 
ral formH of agreement invariably result from interactions. (The unification 
mechanism, however, is considerably more genc^-i] and powerful than the 
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coindejting mechanism of Harriers-} The complexity investigations, in th.Ls 
chapter have exploited this Saw in current transformational theories., by 
simulating the unnatural stair oonstruetjon. 

tn * why, these ov<:fgeneraiimion* reflect the mindset of formal language 
theory, which is to crudely equate structural complexity with syntactic form. 
By choosing thf hail general rule- format that include* all the natural ru)es, 
we need not allow any unnatural rules.. However, as we have seen, we do 
allow unnatural computations, because the mulling rule interactions are 
aimost surely unnatural. 

The remedy is, we must adopt the mindset of computational complexity the- 
ory, which is to equate structural complexity with computational resources. 
In order to limit resource^ v,t musl limit the number of possible rule interac- 
tions- The only way to satisfy these limits is to looh for a mom powerful uhisis 
<jf linguistic constraints, that limit interactions among linguistic processes. 
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Chapter 4 

Complexity of Anaphora 



This diaper defends the thesis that human language is Np-coaiplete, In 
ord«r to defend .such a thesis, wo must defend both, the Upper bound, that 
language comprehension is ill jW> and the lower bound, that language 
comprehension is ^P-hard. 

The. thief obstacle that we face in defending either bound is the incomplete- 
ness of our understanding of human language. Because our understanding 
is incomplete, it would be premature to formalize the linguistic theory, It 
would also be meaningless., because in order Lo be precise, a formal model of 
human language would make statement* that could not be justified scientif- 
ically. Lacking a comprehensive formal model, it is not possible to prove tbe 
upper bound. Nor can we prove the lower bound without a. precise statement 
of the language comprehension (LC) problem. 

We overcome the impossibility of denning the complete LC problem, as fol- 
lows, first We select a natural class of Utterances, and use the scientific 
methods of linguistics to determine what knowledge language users in fact 
have about those utterances. Next, w* construct the simplest theory of that 
knowledge* under an appropriate idealization to unbounded utterances. Fi- 
nally, we pes*- the abstract problem of computing that knowledge for a given 
utterance. This problem is a natural Subproblem of language comprehen- 
sion, because in order to comprehend an utterance in thai class, the language 
user must compute that knowledge, Therefore, the complexity of such a sub- 
problem is a lower bound on the complexity of the complete LC problem, 
by the principle of sufficient reason. 
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Although We cinflOt prove the upper bound, we can still accumulate empiri- 
cal evi deuce for it. One way to confi.nu a thesis is to Cflnftrm Its, predictions. 
The upper bound makes the following prediction: if an analysis, of a linguis- 
tic phenomena Leads to compLcouty outside A'T\ then c.he analysis is in error, 
and the phenomena has an empirically superior analysis whose complexity is 
inside jW, Therefore h every time that we improve an analysis while reduc- 
ing its complexity from outside JifV to inside jVP, t^e Accumulate additional 
empirical evidence for the upper hound. 1 

In litis chapter L *W illustrate both upper and Lower bound techniques with 
respect to the language user's knowledge of anaphora, A nitph&W is the 
process of interpreting anaphoric elements-. An anaphoric or TvffT^niiaily- 
dependenl element is a word or morpheme that lacks i tltrtnsi C reference, inch 
as a pronoun or an anaphor. An fitmpAm* is a reflexive;, such as is marked in 
English by the J+seJ/] suffix, or a reciprocal, such as the English &?ch Gtner. 
A pronoun is an element that does not have its own reference > such as the 
English thf.^ arid is not an anaphor. 

In order to completely understand an utterance, the language user must de- 
termine the intended antecedent of every anaphoric element in the utterance: 
otherwise, he has failed to U.tiCkrstat'id th* 1 utterance. However,, there is no 
known satisfactory characterization of what is u tlm intended antecedent of 
an anaphoric element. 1 * It cannot be any antecedent t because this results in 
the trivial Language ritWc-OrnprdLetisl&ri problem . Such a problem statement 
would allow the trivial (ntJn)salutLon where every pronoun in the utteia.nce 
is assigned a distinct antecedent, none of which were previously mentioned 
in the discourse. 

In order to overcome this difficulty without making any unjustified or Un- 
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necessarily Strang assumptions, we require that solutions to the anaphora 
problem introduce no new in formation. That is to say, the antecedent of 
each Aiiiijiho-x element must be drawn from the Set of available antecedents, 
ifi the current utterance and in previous utterances, produced earlier in the 
discourse. The anaphora problem must also he defined in terms of structural 
descriptions, and not expressions or n.ttetancefi< in order to prevent the triv- 
ial solution where the expression is assigned the null structural description, 
and no anaphoric elements are understood to be present. 

For these reasons the drkaptamu praltUn is; Given a structural description 
S lacking only relations of referentia] dependency, and a set A of avail- 
able antecedents, decide if all the anaphoric elements in S Can find their 
antecedents in A. The set of available antecedents models the context in 
which the utterance i-S produced. 

The Chapter is or^arliEed into three sections. Section 4.1 reviews the Lan- 
guage user'* knowledge nf referential dependencies., and proves in two en- 
tire]} differ.: •■'.a'.:- il,;:i \\ Vi anaphor. | in.. '■•>:; i \- SF hard, thereby est sh- 
ushing the NF-hardness, of language comprehension as a whole and demon- 
sttating the power of a direct complexity analysis. Section 4.2 shows how 
a widely -accepted analysis of the Linguistic phenomenon of ellipsis leads to 
a proof that the anaphora problem is PSPACE-httd. Next, I falsify this 
analysis empirically, and sketch an improved analysis of elLi pais that reduces 
the complexity of anaphora to tfV. This illustrates the utility of the upper 
hound. The conclusion evaluates an alternate approach to the mathemat- 
ical investigation of human language, based on the complexity analysis of 
I i n Euittic t henries . 



4.1 Two proofs of the .\ r P lower bound 

In this section, we US* basic facts about the language user's knowledge of 
referential dependencies to prove in two different ways that the anaphora 
problem is NP-h*rd, What is it that language users know about referential 
dependencies? 

For one, language users know that an anaphoric element u may inherit the 
reference of an argument 0, as in Todd\ hurt himaelfr, where the anaphor 
fiimttlfh understood as referring to the proper noun Todd, or Tvddi said 
Mary liked him u which could mean that "Todd said Mary Liked Todd'. The 



judgement of coreference beliveen a and it* antecedent £ is depicted here- 
by assigning a and ^ Hi* same integral sntaf.ri.pt. (Careful attention mus.t 
be paid to the the intended interpretation of the anaphoric elements in the 
examples below, as indicated by the subscripts.) 

Language users also know that an anaphoric eLement must agree with its 
antecedent in certain respects.. Example* (13) are possible only if Chris is 
masculine, whereas (14) are possible only if Chris is feminine. 

a- Chrisi Liked himself!. 

b. Chris L caught DHL liked himi. 

fl4) 

1 7 a, ChriBi liked herselfi, 

b. ChriBi thought BlIL liked her!. 

This- condition on agreement is transitive, as illustrated by the paradigm ill 
(15), where the student can be masculine (15a) or feminine (lab), but not 
both simultaneously (15c). 

(15) 

■a. The student^ prepared her; breakfast 

b. The student! did hisi homework. 

C ^Tbe student! prepared her L breakfast after doing Ills l home-' 

work, 

The asterix '*' is used In (lSc) to indicate the impossibility of the depicted 
interpretation. 

These :"acts of interpretation are widely det rri >■■.•■''. ,..-. r.w ■.;;,\::,\ir..\ i^iwm.<'i.i 
condition (SAC;: ftii. anaphoric elements that share an antecedent must be 
nundislinct from it and from each other. Two elements arc nwidistitiCt if 
and only if they do not disagree on any common feature (that is, they may 
be unified), 

Pronouns in different languages arc marked for * wide range of distinctions 
in person, gender, number, animacy, case, social cEass, kinship, reference, 
antecedent noun class, grammatical function, thematic role, and so on (cf. h 
Wiesemann 1980; Sells 1967)- It is Sine that every particnlar language con- 
tains a fixed number of agreement features. However, Linguistic theory ide- 
alizes to an unbounded number of agreement features because these features 



and the range of their possible values varies considerably from Language to 
language and does not seem to be restricted in principle (see appendix A. 2). 

The fact that all anaphoric elements thai share an antecedent must agree 
with it and with each Other. ]ii combi n ation with the fact that anaphoric 
elements mast have antecedents^ Suffices to establish the following lemma. 

LemiriB 4.1.1 Anaphoric agtttment can simulate graph k-etdoring. 

Proof. On input k colors and a graph <7 = {V,E} with vertices V ■= 
{^Ij^Si'^iflit} Md edges E t we construct a linguistic expression $ Contain- 
ing |V| pronouns and k avail able antecedents such that G ts Jt-colorable if 
and only if the pronouns in 5 can. refer to the k available antecedents. Avail- 
able antecedents correspond la- colors; pronouns in 5 correspond to vertices 
in G; and disagreement between the pronouns in S corresponds to edges fan 

a. 

To do ttlLs W* need the n hina*j- agreement features ifii t <ft t , . . , p„; the pro- 
nouns- pi, pa, . . r >p n ; and the available, antecedents Ri , Jtj, . . . , R t , Each fl,- 
is an argument, such as aTioun phrase. Pronoun p, represents vertex tv for 
each edge (lf; t fcj) € £ attached to v„ pronoun p, has <ft ~ G and pronoun 
Pi has <fi = l. It does not matter how the pronouns and arguments, are 
arranged in the expression ■>. provided that every arjument is a possible 
antecedent for each pronoun, and that no other linguistic constraint s inter- 
fere with the disagreement relations we are constructing. It is always trivial 
to quicidy construct such a sentence, as We did in example (IS), 

In order to be understood, every pronoun must refer to One of the k availnliU- 
antecedents, if there is an edge between two vertices in the input graph G. 
then those- two corresponding pronouns cannot share an antecedent in the 
expression S without disagreeing on some agreement feature. Therefore 
each permissible interpretation of 5 exactly corresponds to a it-coloring of 
the input graph G- □ 

The reduction uses n binary agree me m features, one for each vertex in the 
graph. The feature system is used to represent subsets of the n vertices, and 
therefore must be capable of making an exponential number of distinctions. 
(In terms of the input length m = \G\, this feature system is capable of 
making 2 mlffl distinctions.) 
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4.1.1 Agreement rcconaiJered 

Agreement is always stated in terms of nondistinctness of feat urea (cf. SAC}. 
The nondi&tlnclness relation may be broken into three mutually- c.xcjusive 
collect! veiy^exhaustive subcases && follows. Two nonidentical elements ate 
non distinct if and only if (5) they are orthogonal (have no common fea- 
ture, eg., [-plu] and [+miuc])i (it) one subsumes the other (is- strictly more 
general than, eg.., f-fplu] subsumes [+plu,+ mascj); or (iii) they partially 
overtop [have some but not all features in common, eg- F [-pEu,person 1 ami 
fplu,+uiaac]). 

The Standard agreement condition makes, two broad empirical predictions. 
However, neither appears to he true. 

The first prediction is that there ire I ang'-i ages with mnidentLral nondiitinct 
pronouns, Otherwise, the SAC cannot he falsified, and should he abandoned 
because it ls unnecessarily powerful, The Strongest Confirmation of the SAC, 
then, would he to find languages for each of tbe three subcases of nondts- 
linetness: languages with orthogonal orOnOuaiS. language* with pronouns 
that subsume each other, and languages with pronouns that partially over' 
lap. Such a language would have a. pronoun system that could not be written 
down in th* standard textbook format (a cbart that partitions the space of 
possible feature combinations"'. 

Although 1 am out of my depth at this point, I observe that English is not 
such a language, nor could I find Such a language wmong those spoken in 
Europe, op in the fourty tdnc non- European languages discussed in Wiese- 
manu (1966), The English system of personal pronouns: exactly partitions 
rhc space of possible feature combinations, as shown in the following table 
(suppies-slng case marking); 





singul 


.ar 


plural 


l*t 


I 


we 


2nd 


you 




■ate 


he 


they 


3rd 


fern 


i-:i l- 




ntut 


it 



(Tbe pronoun one is, not a counterexample, because it does not have a 
linguistic antecedent, Rather, it hat an arbitrary interpretation and may 
only "accidentally" corefer.) 
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T:n: second prediction is that nonidenticat nondi*tincl pronouns can share 
an antecedent. Given the difficulty of obtaining truly nondJstinct pronouns, 
this prediction is not easily tested. However, w<- may imagine the following 
scenario. You art- talking to a new friend about his recent health checJiup 1 
and, not wbhing to make any assumptions about the gender of the 1cxam.ir.in5 
doctor, you use the third person plural pronoun {16a) instead of either third 
person singular pronoun (16b). 

( IS) 

a, About your doctor-), did theyi seem competent? 

b. About your doctor], did he L fsh.^ examine you thoroughly? 

In this case, fftcy is used as, a pure third person pronoun. unmarked for 
number or gender, and henci: subsumes both he and she. However, it is jtlil 
aet possible to use thty in combination with he or she, contra the Standard 
agreement condition: 

(17} * About >'0ur doctor i, did theyi seem Competent when hei/she.; 
examined you? 

Those and related fact* suggest that the agreement condition must, be strength- 
ened, to state that every argu m en l j ti a. senten ce must have a unique anap hom 
root morpheme an each of the Language's anaphoric systems, That i*> we 
assume that the systems of persona], relative, demonstrative, and interroga- 
tive pronouns are all independent. This version of the agreement condition, 
which partitions the set of anaphoric elements into equivalence classes, is 
the anaphftrK equivalence f&ndilion, 2 

The anaphoric equivalence condition helps to explain the uncertain nature 
Ofobviation violations between pronouns with distinct amphoric roots. The 
split antecedence examples in (16) demonstrate that— unlike obvjation vio- 
lations between pronouns that share the same anaphoric ruut morpheme — 

Th.ia condition may tHidttJj-iajL r be i fire. »Wut language laiiiiaiticin., H ram* thai 
Ifcc language icqni*ttjon devicr firaL chaanw a «t of relrvuH tern antic, syntactic arwl 
phaQDloaiciL distjncliaiis. r,r*t p*[lUhih.» the r«attia H featuie np*cc ialn natural daaae*, 
and finally BBijgn * a pfconolflftk-ji|i ' JiBlintUw amphoric- root JBCjrplie.me Uracil dara |>L, 
Ctiat 19S6J. On* oaniequenc* of such an aiTGUJtition procedKM *tiaM be the anaphoric 
«Hti valence conditiflJi . Ultimatet^. the a n. * p lw? t it *«) uivaLen.ee condition la a JiBguisik pro- 
«M that simnLifirs (he relation between sound add meaning:, on™ * j>rcmou.D is f_vnLi,> 
tic.ally iinlwd tD a given ■.n.ttndtni, rhen Vbe joond n<f that pranewn com** to ilaiid Cot 
IkaL antecedent ^IlIilq the scope of ifus *iHe-ianc* 
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obviatrOtl is not always enforced between pronouna with different anaphoric 
loot morphemes. 

* 'a, Johri sujyMEted to BlIIj thai [ln-j *htH>t th<-m|t -jj.] - 

b, Blll 1 reminded SuSj that [hex introduced them,{ 1,3} to the pope]. 

Rather, lexical factors, such as the choice of verb, play a significant role, 

j lJ>b 

a. NaVarrei. suggested to Benedict* that [hej persuade them^-j].^ 

(PR.Of to perjure themselves]]. 

b, *Navarrei suggested to Benedict* that [hea tell iliem^fi^} 
(PK.O,- to perjure themselves j)]. 

4.1,2 Relations of referential dependence 

We have seen that an aphorj c elements must have antecedents, subject to 
;n ,u'.r<. , t , lin. , ].l cuiL-dLli'-'Il . V-ltIxi^-^ " I ■; oli:i.|i|,:i:..:; i - ■ 1 1 1 i -^- : : I ■ ■ s - ■-.- 1 - : - : i - 1 -- : , I i::i,. '', 

second component of linguistic, knowledge is that that pronouns must be 
disjoint i jl reference from certain, arguments. For example, every English 
speaker knows that 'I'oddi hurt him.] cannot mean that "Todd hurt Todd". 
This judgement of disjoint reference, that or cannot refer to £, is depicted 
here by assigning a the integral subscript of 3 preceded by an asterisk. 

Knowledge of conference and disjoint reference must be represented in the 
brain of the language user, and by every 1 scientifically adequate linguistic 
theory'. The simplest, and least controversial, representation is to postulate 
two abstract linguistic relations: an asymmetric link (i», 3) relation that holds 
between an an ap hoci c element a and its immediate antecedent j3, subject to 
the agrnfihu-ir condition, and a symmetric obviate!^, 0) relation that holds 
between two arguments a and fl that cannot share any referential values 
(Higgsnbotham, 19S5). 

Every structural description, then, includes: a directed graph of link relations, 
a* well as an undirected graph uf obviate relations whose vertices Are the ar- 
guments in the structural description and whose undirected edges represent 
the obligatory non&vei lipping reference of two arguments. Let this graph 
of referential dependencies, which consists of the ablate and link relations 
of a given structural description, be called the RDG, 
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Our goal J g to prove the NF- hardness of the anaphora problem without using 
the agreement Condition. The idea of the proof will be to construct RDGs 
that simulate some NP-compiete problem. Lei us therefore examine a range 
of syntactic configurations, in order to better understand the distribution of 
link and obviate relations ju linguistic representations. 

The first, most Important, svntaclie configuration is "local c-command"*: an 
anaphor must link to some locally c-commanding # and a pronoun mast 
obviate all such jS. 3 To a first approximation, two elements are local if then- 
ars CO- arguments, that is. arguments of the same verb ot noun. {'The ejnacl 
definition of locality doefl not mailer for our purposes; all lhat mailers here 
is the fact that antecedence and disjoint reference are possible or necessary 
in some configurations, and not in others.) We say /J c-command tt in a 
phrase structure tree if and Only if all brandling nodes that dominate 8 In 
the tree also nominate a. lit particular;, the direct object c-commands the 
indirect object, and the subject of a clause ^-commands both direct and 
Indirect objects. 

An anaphor must be linked to a unique c-coramandiiiKj. argument, and this 
argument must be locai, This is Illustrated by the paradigm in (20), where 
the domain of Reality is indicated by square brackets. 

(201 

■V jJohn] shot himself]] 

b, [John] introduced Bill} to himself]^] 

c. )ohn( thought BiLLa said I Mary J iked himself, t y. 3 J 

Example (20b) shows lhat U anaphor can take any c-commanding an- 
tecedent inside the local domain; example (2[k) shows that an anaphor 
must have some antecedent inside the local domain. Mar*, is no; a possjhle 
antecedent for himself in Vl\)t) hecause they disagree on gender. 

Pronouns are locally obviative: a pronoun cannot shire referential values 
with any argument that c-commands it in its local domain. (The domain 
of Lor.aduy is roughly the same as for anaphors; again t all is needed for the 
proofs below is that there eKi.v. i.u:i figurations that result in obvjation.) This 
is ilhiHtraic-d by the paradigm in (21), 

[ Iu; requirement iki-X ijiiphcn Jiivt Local *iH*cedcnli a c+J|o j ^conditio* A" fliid tJie 
r^dr-hini' i.-.n r.rt-i, :,..,■, I... !.j-i.iv ..i.v.nilv, m -^..^ -coadic:,,,, p" i n ,r,. i „,.„.., ..... 
tiler* In re. 
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V- [J^htii shot htm_i] 

b. [John] introduced DiJlj to him„|/. 2 j 

c. John | thought Btlt-; said! [Mary liked hicrL-,,-, ] 

Example (21b) shows that a pTonoun is disjoint from all locally C-CODiru&Jldiilg 
arguments; example (21c) shows that a pronoun can link to any argument 
outside its local domain. 

Like- the agreement condition, the prohibition against sharing referential 
values is a transitive condition that is enforced globally, as- shown by the 
paradigm in {22}. 

{22} 

1 a. Johm. *aid thai ^BiLl^ lihc-d him^.j]. 

h. Johni said that fhci^j liked Bill;], 

c. *Jfthrn said that [hen liked hirnij. 

Him can refer to Jahfi in (122a); he can refer to John in (22b), but Ac and 
him cannot both refer to John in (22c), because ne locaHy c-commands him 
and hence they are obviative. 

Ohviatioji appLks. cc[u?J]y to all linguistic corefeirence,. including the intra- 
and extra- sentential Linking of pronouns, because obvia-tion cannot be vio- 
lated, even if a pronoun and its antecedent are in different sentences. With- 
out loss of generality then, all Linking: in this chapter wjlL be tntraseniemiaJ 
fu-r expository convenience. 

The other local c-command configuration is "exceptional case- mar king," {ECWl. 
where the subject of an ECM wrb Locally c-commands the subject of its In- 
finitival complement. This is illustrated by the paradigm in (2 3), with the 
ECM verbs tdftttl ind ££ptft, A 

(23) 

*- Johm wants fhimseifi to shoot Bill] 

b, John] experts [him.i to shoot Bill] 

Examples (23) demonstrate that the subject John of an ECM verb locally 
c-commands the subject O of the infinitival complement [a to shoot BilQ, 
for both anaphora and pronouns. 

Ttieae VEihi ira ca]|.ttt Vxe^ptuMiil fiAf-iti »[kLc.£ T h«:a.Tjac, unlike at\n-.r v<-thifi lK*.t 
1i](f i fiinth- iUusai cam p Irene at. £-0X4 y«ibj lolce la infinitival clliUS&l complement and 
jjisijjs i.h*irKl inae la Lis 3ul>j«x:l. Oilier ECU V*tb* in Fnfclisti Lndndu Wirur. prcftr, 
tike, *nd rallied vtrris 
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Our goal is to prove that the anaphora problem is NP-hard, without -using 
any agreement features. Let u.q therefore pause to consider how such, a proof 
might, work. 

Imagine that we muat color the following four-vertex graph G<l with three 
colors: 

{(ia%{2, S),(M),(4*2)} 

Then our reduction might construct a sentence containing three available 
antecedent* and four pronouns. Tin- first part of the sentence, Before Bitl a , 
Tbfltfc.- ami Juci± uiere friends... , t would represent the three colors, where 
each proper noun corresponds U> a different color, The second part of the 
sentence would have an oblation graph equivalent, to G<> where the pronoun 
Pi in the sentence corresponds to vertex i in G^. As expected, it is difficult 
to understand the resulting sentence: 

{24) Before Bilk, Tom^., and Jack,, were friends, 

[he] wanted himj to jjitrodu.ee him a to ritnijj. 

The corresponding obviition graph appears in (25). 



m) 



ryj^Ktj 



i 




HCM 



A 



COARO 



t:o/\SiO 



Each vertex is labeled with the numerical index of Ue corresponding pronoun, 
and each edge, is labeled wstb the syntactic configuration responsible for the 
cones pending obviate relation, (Recall "coarg 1 ' means "ftigument of sua* 
verb or noun," and "cdn." means "exceptional case making" cor figuration.) 

By carefully grounding the reference of each pronoun: in turn, we can confirm 
that the oblation graph for (24) exactly Miresponds to the- four-vertex 

graph G+. Let he L link to Bil^ in the sentence— this corresponds to coloring 
vertex 1 in G A with the color *, Then in the simplified sentence [Bill wanted 
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Ai'raj to introduce, him^ to him 4 ] we can dearly see that Bitt can be the 
antecedent of any pronoun but him-z— this corresponds to G-f, where coloring 
vertex 1 with a given color only prevents us from coloring vertCK 2 thc 
ilmt color. Continuing in this fashion, one can convince oneself that the 
pronouns in such a sentence can find their antecedents in the sentence- ij~ 
the corresponding graph G* is ^colorable. 

The local c-command configurations used, in {2i) Only give rise to simple 
obviation graphs, and therefore the- second proof of N'P- hardness will employ 
three additional syntactic configuration*.; adjunct control, strong crossover,, 
and invisible obviation. 

In Lhe expression Sue screamed before jumping, all English speakers know 
that Sae ia the understood subject of the gerund jumping, that is, every- 
i!iH' knows that Sue did the jumping. In order to represent this linguistic 
knowledge, as we nniHt, we may postulate a silent pronoun 'I' HO' in the 
subject position of the adjunct \bcforc jumping), and obligatorily link. PRO 
to Sue, 

(2tj) Sn*] screamed [before PRO] jumping] 

This is called "subject control * because the reference of PR,0 ia controUed by 
the auhject of the main clause. Another example of subject control appears 
in (27a.) with the verb promise. Contrast this to the verb persuade in. (27b}, 
which is an object control verb, 

(27V 

*, Tom] promised Maryj [PRG^.j to attend school] 

b, TOKh ycrsuiL'ied Maryj [PRO. ]ri to attend School] 

Further evidence for the existence of this silent pronoun comes from its 
interaction with overt anaphora. Observe that himself must refer to Mil in 
(2ga), and Kim must be disjoint from Bill in (28b). 

(28V 

a. Mark] vomited [after PRO t getting himselfi plastered] 

b. Mark] vomited [after PRO| getting hira,] plastered] 

Without PRO 1 , such facts are a complete mystery. But otice the understood 
subject of the gerund is explicitly represented using PRO, as we have done 
in (2$), the facts are- trivially accounted for as canonical configuration!, of 
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local c-command between silent PRO and an overt ailiphoric element. (In 
ail}' event, the- complexity reduction proceeds whether PRO exists Of not; all 
thai matters foj the reduction 3s the empirical fact that himself must T^fer 
to Bill and him must be disjoint from Bill in expies..iiftns like (28).) 

"TrVh-movement* Is the cOnhgu ration that holds between a wh-phrase, audi 
as [who] or [urftaJ JKtTOn], that appears displaced from its- underlying ar- 
gument position. For example, in Whoy did Mary .*r¥: t k * -lie underlying 
position of the wh-phrtw u<^ as the direct object of the verb see has been 
man Led. with a trace f*. oninde.Ned with it, This represents the fact that 
tohty stands, in the fl-iane relation to the v^rb st* as it does, in the related 
expression Mary saw who. 

"Strong crossover" occurs when an anaphoric element a intervenes between a 
wh- phrase and its trace, and c-commands the trace. In such a configuration H 
a obviates the subject of the wh -phrase. This is shown in (29a), where the 
pronoun he c-command* the trace i* of the wh-phrase [which person], and 
for this reason must be understood as disjoint from the person who Mary 
kissed, 

(29) 

a- [Which person^ did he,*, say ( t kissed Mary, 

b. [Which person]* (* said hxi kissed. Mary. 

In (29b), however, there is no slionp:, crossover frt:i figuration, and SO obvi- 
ation. That is, ('29b) has an interpretation of the form, "for which person 
z, did x say z kissed Wary." Sudi facts are dinieult to explain without 
an expllril trace, because the wh-phrase {which person] and the pronoun he 
stand in the same relation in both sentence*. 

In the expression The man ujAo> Mary sflip t^, we say that toho heads the 
relative clause {who Mary *nir, « r ,i that it predicates, its- subject, [the manl 
When the relative clause contains a pronoun in a strong crossover configu- 
ration, then tbi pronoun obviates the subject of the relative clause as in 

cm. 

(30) (the man]t [whot he.] likes t k }. 

"EUipflU* is the syntactic phenomenon where a phrase is understood but 
not expressed in words, as in The men <t<e dirtier and the utomen did too, 
which can only be understood to mean that 'the women did eat dinner tOO r . 
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For this example, we would say that the verb phrase \eai dinner] his been 
eUipsed Lit the second conjunct; this is called VP-ellipsiir 

A configuration of "invisible obviation"' arises between the Suhject of An 
ellipsed verb plirase and. the direct and indirect objects of the overt verb 
phrase, because both subjects in effect locally c- command the other argu- 
ments of the verb- Observe that h.im can refer to Romeo in { 3ta), but not 
in (31b). 

(31) 

a, Uarl£ L wanted Jesse to love hirci] 

b, ""Marki u-anU'd Jrm' to 'love him]] before Y&Q\. allowing 
himself] to [c\ 

In this esampje, the anaphoi kimxelf is obligatorily linked to PRO, and PRO 
to the matrix subject Mark. The pronoun Jn"m invisibly obviatea himself, 
"he subject of the ellLpsed VP r because they are in an invisible configuration 
ofLocid c-command, The liDG for (Jib} appears in (32): 



(32) 



ctmurai 




Q PRO 



rem 



hirmslf 



t'l'i'ij'j.^i r 



-vr.pl-o Lines depici relatione of deviation, while d-ouble tines depict relations 
of wreference. Vertices are labelled with, the corresponding noun phrase 
arguments, and the edges are Labelled with the con figural ions to which they 
are attributable- 
It cruet again he emphasized that the complexity cla.is.ifi eating of this sec- 
tion in no way depend on the existence of traces, PRO, or on any other 
details of the Linguistic analysis . The reduction relies onLy on the empirical 
facts of Obligatory disjoint reference in configurations Such as (2nb) h (20a), 
(30), and (31). The Linguistic analysis js included for pedagogy,, and to 
organise the presentation r 
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This concludes our survey of the language mat's knowledge of referential 
dependence, which has been studied extensively. The next step is a direct 
complexity proof. 



4.1.3 FW)rll satisfiability to referential dependence 

The conceptually natural reduction is, from graph coiorin^ to the anaphora 
problem. However, the transformation of arbitrary graphs into linguistic 
representations Is cumbersome. To overcome this difficulty, we might reduce 
from JSAT, by way of the graph 3- coloring problem. That is, On input a 
Boolean formula / in 3-ClST,, we would first use the classic reduction of 
Law]er(l97tj) to construct a correspond ing instance g of the graph 3-caforing 
problem. Next, from g we would construct an instance («, a) of the anaphora 
problem, such that the anaphoric element! In * can find their antecedent? 
in a iff 3 is 3-colorable (and / i» satis fiable.i Hy restricting oar attention to 
this class of B 3SAT graph colorings; 1 we would simplify the reduction into 
the task of transforming, a simple class of "difficult" graphs into linguistic 
representations. Of course, the intermediate "graph 3-coLori n g T: Stage of the 
reduction won*t really be used in the proof. 

Lemma 4 .1.3 Rtfcrcntiai dependttiOtB can simulate SSAT. 
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Proof. On input a Boolean formula. / tonsislins oe the clauses C x , C-i^ . . .C, 
in the variables x\ ,i;, , , . , i n , we construct a linguistic representation a smd 
a set of availahle antecedents a such that the anaphoric elements in & can 
nnd their antecedents in a iff / is satisfiabk, 

The set n will contain exactly three distinct antecedent^ True, False, and 
jYeurrv', These noun phrases represent, respectively, the three possible- truth 
values 'tiue ! , 'false 1 , and 'unassisted.' 

For every variable Xj in /, j wilJ contain two pronouns, one to represent Xj 
and the other to represent its negation 1 f , In order to preserve the semantics 
of negation, these pronouns mast ohvi ate each other. Both will also obviate 
the proper noun Neutral, and therefore can only link to TVueor Faise. To be 
precise, for every Boolean variable we I mild an object rtmtrol construction 
(33) that contains two passible targets for ellipsis,. YP i and VPj. 
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This is the phrase structure that would be assigned to expressions Each as 
/fe persuaded him in introduce kirn Uj Hcclit?. 

la this construction (3-3), £on figurations of local c-command in the lower 
clause cause mutual obt'iattou among PRO, the pronoun for ij, and Neutral. 
The object control verb persuade obligatorily links FR.0 to the pronoun for 
z } , as depicted by the ItTTOW, The subject position is filled with a dummy 
prononn so as not to increase then number of available Anrftrwients in thf- 
construction. The resulting EDG ensures that tbe pronoan for z-j must 
refer to eitheT True or FqIec; thai the pronoun for J, must refer to the other 
antecedent; and that neither pronoun can refer to Neutral. In short, the 
construction (33) correctly ensures consistency *f truth jms-ignments. as well 
aa correctly representing the semantics of Boolean negation. 

Both pronouns arc itl the direct nbjer.L position of a separate verb phrase, and 
hence passible targets for VF-tllipSi* and the resulting invisible deviation. 
We will take advantage of this below., by representing positive literals of z } 
is. Buipsis Of the higher VF| h and negative literals of IJ as ellipsis of the 
lower VPj. 

For each clause d = (ftf V t| V c,) p we construct the rather intricate syntactic 
structure shown in figure 1.1, whose gra.ph of referential dependencies ap- 
pears in figure i.2. The effect of this obviation graph in combination with 
the limited set of available antecedents is to ensure that one of the three 
elllpsed vc-rh phrases in ftgurr* 4.] must contain a pronoun linked to the an- 
tecedent True. This corresponds exactly the requirement that each clause 
contain a true literal, concluding our simulation, O 

It is not to be expected that the linguistic expressions constructed by tbe 
preceding reduction arc easy to comprehend, any more than we expect to 
actually baild the physical devices used to prove lower bound* on the com- 
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FiguTE i.li Tha phi»w structure simulates the tth Bcmlran clause Q = [a; V 
hi Vft), wilh irrelevant. Mails suppressed. Dashed auaws depict the predication, 
of & noun phrwe? by an cjdraposed relative clauBC. "S" is » clause, NF' 15 a 
noun phrase. "VP" is a verb phrase, and TV" a prepositlona] phiaaa. AU MPs 
dominate- pron&urjs. The structure *cnta:iis c-i.i.f:K'jraiions of Incsil c-command, 
strong crm^DVflT, adjunct eontroL, and invisible obviaLjan, yielding ilie grip;, u-f 
referential dependents sho^n in figure (4.JJ. The ta^rta of the euipsed VPa 
■re the VPa in the literal constructions (33), depending on the paWir.y of the 
corresponding literal. CnnMrjuentfy. NP fll NP E , and NP L invisibly obvia^ the 
pronouns lepreseiiLJng a,, b i: and n,-, respectively. This is the pJirii*e structure thai 
would be assigned tn i-xpressions. such as Ntctor m*t Aim^, «jA* a Jte L ers*cf*rf Jh'm. a 
io u'flitr Arrrc, /mtmea!. teAo fl a f4 peeved hi* Arf /*/ uirt J fl a/fer ezpcutn? JWrJ/s 
to [ej fert A - Wore itlliitf kmttfa ic /=/. (Indices, cra-tefr of wb-movsmeju, and 
elliptical VPa art included hm wjfcly to help Ibr reader align the expTtaalnn with 
its phrase Btruciuie.) 
■ B2 . 
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FLpire 4.2: TtlL& IS the graph of TcfwtntirJ (Uipendeiiuififl fur Lfoe jitiraae alructuti; 
of figure 4.1. Single lines depict gbviatiais islatioDfi; double lines depict relations of 
cotnGtMan, tlwt Is, link* n.nd [H-editaticiDS. Vertices- in the graph coiTespond to noun 

phriisr nrgi.imrnlx, ^nil ari* lnb«ll*:i] wjtli die identifying indicts from fi|UH4.1, The 
rclg?? in Lhr graph* ir« likswisi! labelled wkb the configurations to which '-hey arc 
attributable. Etetall that "e&alg." and "«m" 4TC configurations oflnc*J ^rmnmsn;:; 
"wjiX " is For a s-tTQng cr-os&ovtr involving a wh-pkirase, and "ellipsis." for the juviajble 
obviation aj>Li.g :"tom t 1 1 ■. - ■ - 1 1 ■. :*-■* ••■I' n nrh phTa.ir rKpresn-ir.jLi^'-iie ril- •■. i:n rJoo-fean 
literal from {33). The ofc-Yiation graph LHn-t. remit* when eofefeie-ntiad vertices are 
coalesced, in combination with 11k three available antecedents., ensures that at leasl 
ajif of pronouns Tcpr^smiiiiR a„i h orci must link to the propci noun True. This 
Mrf-napGtids exactly t* the constraint that a true- Bnnleaji 3-cIwi« contain at k«t 
one tine Literal. 
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plenty Of problems it) robot motion planning (Reif l£7flj Rjeif and Sbarir 
1985^ Canny 1Q86). Certainly, it is not possible to build physical devices of 
auch intricacy, any more than it is possible for a language user to compre- 
hend the utterances we ha™ just constructed. Yet the practical questions of 
what physical de-vices tan and cannot be built h of of what linguistic expres- 
sions can and cannot be easily understood do not concern ns here. We want 
to understand tin? theoretical Structure of abstract Computational problems, 
and use complexity analyst* to better reveal this Structure. 

All that remains is. to state the main theorem of this section. 
Theorem fl The anaphora -problem it NP-hartf r 

Proof. By kmma 4.1,1, or by lemma 4,1,2. fj 

We now have two complexity lower- bounds for human language comprehen- 
^■,i. 1 1 -r rriy only .,:i r :■!,.■ <■ rn ;ji :: cal I.l..-.k <-,{ referential dependency, ll dot s 
nut mailer extcilp fccur the atfiditivn* on core/Ensnct? and disjoin* re/ercner 
are dlflferf, onVy that their U rr such corufitwijai. at lAere are in oH faioum 
oumftn iiriQUGacjf. For this reason, we tnay believe with confidence thai the 
NP-hardnest. result applies to all adequate linguistic theories. Moreover, the 
directness of the reductions suggests that the anaphora problem is on* of 
the more difficult subprohlems nf language comprehension:, because graph 
fc-coloring Lt one of the most difficult ftp-complete problems, a trap-door 
function with no known approximation scheme, and known to be average- 
case NP- complete. 



4,2 Evidence for an A'P upper bound 

tacking a complete, Scientifically plausible linguistic th Pory f it 5s rot possi- 
ble to prove an upper bound on the complexity of human Language. It is 
however possible to provide empirical evidence for an upper bound, and that 
is the task cf this section. The argument goes as follows. First , We exam. 
ine the linguistic phenomenon of ellipsis, and present empirical arguments 
for a simple theory of the knowledge that language users have About Riieh 
phenomenon. Next, we us* this theory to prove that the anaphora problem 
is PSPACE-hard. Using the insights of the complexity proof, we reexamine 
(he phenomenon of ellipsis, falsify the copy-an d- li n k theory, and suggest an 
-..:>, :i: ,li, -iprrlrrr ■:,:<•:. —r.-saarbc 1 1 .*-.:--.. Finally. ^ |in.:vp rhV. \\ lK 



anaphora problem is in AT according to the predicate-sharing theory. By 
reducing the complexity of ellipsis to inside A'P, while ^tritely improving 
the empirical adequacy of the thfloiy of ellipsis 5 we provide evidence for an 
.\"V upper bound. 

In d*vg|opins onr simple linguistic theories. *e will briefly introduce the. 
relevant phenomenon, state the theory, and conclude with a concise enu- 
meration of ihe empirics] arguments in support of the theory, 

4,2rl Simple theory of ellipsis 

A central goal of lingui sties, is to explicitly represent the knowledge that 
Language users have ahont utterances. Let us purely as a matter of con- 
wfli*n« distinguish the representation of ho*' ail utterance evpress^ri In 
words and phrases, from a r^ presentation of the logical aspects of its mean- 
ing, such a.s referential dependencies and predication. Let us call the former 
representation the surface form of tha structural description, and the latter 
represent &tion, the foaicett form. (The number of levels of representation 
does not in and of itself affect the computational complexity.] 

Theory 4.1 The logical form of ellipsis ts constructed by ? recursively) copy- 
ing the. avert structure into the position of the corresponding elapsed struc- 
ture; an anaphoric c/crnen( a may link to its antecedent cither before or after 
copying; when th$ anifcf4e»t of <* is « qmniifi&i ftp fi, then « rnv&t link to 
after copying. 

Evidence, First, the elliptical .structure la understood, as though. It were 
really there, as shown in (33)- 

*. The men [ale dinner) and the women did (c) too. 
b- "the Women did eat dinner loo 1 . 

This- fact about our linguistic knowledge must he represented somehow in 
the logical form, perhaps hy copying the overt structure into the position of 
the null structure, as first suggested hy Chomslry (19W)- 

Second, an elliptical structure may itself he understood as containing an 
elliptical structure, as in (15a), which is understood to mean (Job), 
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a., Jack [[corrected his spelling mistakes^ before the teacher did 

[e]i,]j and Ted did [e_ 2 too. 
b. Jack corrected Ids spelling mistakes before the teach er did. »r- 

jzd his spelling mistakes and Ted did C&rfttt his spelling mix. 

lnl-m bef&rv the teacher djd correct his spelling mi-stokes. 

This suggests that copying is a recursive process. The depth of recursion 
does Hot appear to he constrained by the principles of grammar, as shown 
in ::if»). 



Harry {claims that jack [[eo-IMtted his spelling mistakesji 
the teacher did fe]i] a and that Ted did [^3 too) 3 , but Bob d 



Third, the invisible structure behaves as though it was really there, In 
particular, it can j n-d U-C>C a violation of ohviatjou, as in the discourse (ST), 

(37) Aon: RomeOj wants Rosaline to jlovc himj (i = 1} 

Ben; Not any more — now Rosaline wants Romeoj to [el 
([tove Aim,-], i ^ I) 

In this example, Ann's use of the pronoun Aim is: most naturally understood 
as referring U> JrWro. Yet when Ben replies, the co-referential interpretation 
[i — 1) h no louder possihle in Ann's statement. These facts of invisible 
abvmticm are difficult to explain unless the overt structure, im in fact copied 
in the syntax, As illustrated in (3S), where the obviation violation between 
AjfH] and jRomcoi. has been made explicit by copying the overt VP love him 
into the position of tin? null VP. 

(3S) Rosaline wants [Romeo t to love Ai'm.i) 

The invisible structure is not merely an invisible VP -pronoun, simply be- 
cause the obviation violation in (33a) van i shea when an ovurt pronoun \s 
used instead in [39b:. 

a, Juliet! thought the Friarj [poisoned hen] without realizing that 
she* | did [e|. 

b. Juliet i thought the Fria: 2 -poisoned herj] 3 without realizing that 
she] did it 3 . 

hi"; 



['■.:!_; rl.il. ri.>r:i'S|i:u : _ i 1 1 PC .uib|iI.o: i'. i-lfl'il-"!l.".S in :h(! ovi'.'ll Hi.d invisible si I Mi 
tmes may be understood as Laving different antecedents, as in (4H), where 
The invisible pro-noun Aj'd is ambiguous, referring cither to Felix {invariant 1 ' 
interpretation) or Mat { l cOYiri ant 1 interpretation). 5 

i'-lO) Feiixi [hates hlsi neighbors! »ci<3 so does Max^ [e], 
([Jwi/es AiS(/2 n£ njjtofcwT]) 

This suggests that an anaphoric dement mfcv be linked to {that Ls, related 
to) its antecedent either before the overt structure is copied, resulting JEl the 
invariant interpretation (41], Or ft-ftet , resulting in the covariant interpreta- 
tion {42), 

a. FchXj [hates tits i neighbors] and SO does Max 2 [*]. 

b. FeliXi [hates bisi neighbors] and *o does Maxj [hate hisi neigh- 
bors]. 

(-12) 

a. FellXi [hates his. neighbors] and so does Maxj [*].. 

b. Felix] [hates bis 1 neighbors] and so does Max? iba-te hiso: neigh- 
bors], 

Fifth,, the invisible pronoun must agree with its antecedent, which excludes 
the covariant interpretations in (43) Lhat are possible ill the mjnim&lly dif- 
ferent examples in (44}. 

4431 

a. Barbara i read hei L book and Ericj did \e\ too. 

([read Arr L /,^ fetwt]) 

b. We! ateouri vegetables and so did Bobj [e). 
{\ai£ ovrjf ml vegetables']} 

(44) 

a. Barbarai read lieri book and Kate? did [e] loo-. 

{[rtadhcTifz book)) 

b. Wti ate our] vegetable and so did theya [e]. 
([ate ett^fz vegetables]} 

In ftirK Axa.mp]^. fitf-hil Jtccntiuri mutt ne pud tD «h.e relevant OExna-lriiaJ of (lie suU 
structure, indicated rrilb. brackets, and ike ialemkd nfrrtTiM cif uiifiJicitit elements, as 
L&dicaled in the inlkned parerjlbeuci] following tin; fiimplt. 
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Sixth, the covarjant interpretation 1b forced when the antecedent of the 
anaphoric dement is a q a JintLfierl noun phrase {QNP), as shown in (45). 
(That isi (45) must mean that every boy ate his own dinner; it Cannot mean 
that every boy ate every man's dinner.) 

(-IS) Every mam (ate hJsi dinner] and so did every boyj [e] 
[[tot hia^^ dinner]} 

Therefore, an anaphoric dement must be Linked to its antecedent H after 
copying. when fi is a quantified noun phrase. 

To summaiize, we have gc-en evidence that the overt structure mast be copied 
to the position yf [mil structure in the syntax, that copying is a recursive 
process, a^d that anaphoric elements may he linked to their antecedents 
cither before or after the copying, and that they must be linked after copying 
when their antecedent is a quantified noun phrase. □ 

The earliest account of invariant and covariant interpretations in VPfl, <iue 
to Robs (1A67), is equivalent to this theory 4,1, because deletion in Ross's 
deep- structure to surface-stmctare derivation is identical lo copying in the 
surface form to logical form mapping. This model has also hewi proposed 
in recent government-binding literature, See for example, Pesetsky (1932), 
May (1*95), Koster (1987}, and Kitagawa (1989). 

More generally, any linguistic theory that represents the meaning of an el- 
liptical utterance using device* that can achieve the effect of copy and Link 
Operations vuij] inherit the complexity of the copy theory 4,1. This is tine 
regard Less of how that linguistic theory is defined, how many levels of rep- 
resentation it has, or what they are called, 

4.2.2 Complexity outside A'V 

In this report, we only consider the problem of assigning structural de- 
scriptions to utterances, vhich is a trivial Buhpnoblem of the much more 
intractable and Less well -understood problem of determining the semantic 
'truth value' of a given utterance. The following proof shows that assigning a 
complete structural description to ft given class of utterances can be as diffi- 
cult as determining the truth of quantified Boolean formulas; the proof does 
not make the entirely Unnourishing argunaenl that determining the 'truth' 
Of human language utterances can be as difficult as determining the truth 



of quantified Boolean formulas. 

Lemma 4^2,1 The anaphora problem is PSPAGE-hard, 

Proof By reduction from QUANTIFIED 3SAT. The input ft in quanti- 
fied Boolean formula in pirenex 3- CNF, consisting of alternating quantifiers 
V*]3#2 -,,Vl^^j3ln preceding [and quantifying the literals in) the dausea 

C\ , £7? j , C7 P in the Boolean Variables S\ , £ 2 , . . . , x*, . Each clause CGnt&i rts 

exactly three distinct literals labeled by d = [&i V hi V a). 

The output Lfl a surface form S and a set .4 of available antecedents, such 
that ail the anaphoric elements In S have antecedents, ill A If and only If II 
is true. In cider to verify that all anaphoric elements- in S have antecedents, 
we must construct the logical form of S. The reduction uses one binary 
agreement feature to represent literal negation, and one n- valued agreement 
feature for equivalcntly, logj" binary agreement features) to identify the n 
distinct Boolean variables. 

The idea of the proof is to mimic the structure of ft with linguistic con- 
struction^ by reducing the quantification of variables in ft to the linking of 
pronouns in $. Each quantifier Qt in ft will correspond to a pair of avail- 
able antecedents in S, one to represent i = and the other to represent 
x = 1. Boolean literals in S"! will correspond to pronouns in S, As shown 
in figure 4.3, the surface form 5 Is built from three distinct components: 
universal quantifiers, existential quantifiers, and Boolean clauses.. We will 
now motivate each of these parts in turn, using intricate yet still natural 
E:ib£]i;:L sentences. 

The first step is to simulate a universal quantifier. Recall that a universally 
quantified predicate [V x;P[x; }) is, true if and only If \P(x, = 0) A P(x; =. 1)). 
The latter Boolean formula can be expressed in a VP-ellipsls construction 
whose surface form is abstracted in (4o), 
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Figure -13: The surface form S Lhnt rnTrr*ponds to the input instance ft = 
V«t3la . . . Vt q , ] 3i„ [C*] , i?2 1 . -'C p ]. The- ijun.nl ifirr cnnstTUCtlDuH curtain tmj *n- 
i^wdents to represent the two possible truth aflajgnrncnt* lo the quantified varl!ib]i*. 
Each uaivcra*] quaiililier ¥x, ia reuTesciitdl hy a VP-eLLipsis template, In the lopcal 
form that ccrrap-nnds to S, each of the rt/2 firmed overt VPs Is copjrd to its cor- 
responding elhrjsted VP position \vpt], ac curd i ng in the copy-and-liink theory 4.1. 
Eiwh existential quantifier 3j, +1 is repnefienled by in e*trapo&ed strung cjnssovcr 
t*n*plaie, as diaeuaaud in the tfKt. Lath clause <7j is rapr«*rntcd by a pigeonhole 
cotltt ruction that contaJiLs tJirw pronouns, one fen each liter*] in Cf, one uf Lhr» 
pronoun* (the aetata 1 pronoun ) nwut Link to an antecedent cml^d* that construc- 
tion, Ln aoiiJK dominating quantifier cujistrqction, These obligatory long distance 
liaJra are drawn with dashed arrows. The elected pronouns leprwent the liberals 
that satisfy the djiiums 
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According to the copy- and- Link theory 4,L the Language user 1 * kiiywkdgc 
of Ehe construction (46) 5s represented in the abstracted logical form (47). 
Fiist, lh# overt VP is- copied to the position of the- null VP. Next, pronouns 
inside the original and copied VPs link to their antecedents independently. 



an 





S md bo do 
QhTP VP 
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|x,-=0] V S 



The VP is used by the reduction Co represent the Bool-can predicate h'[x;}\ 
the embedded pronoun. #, represents a true literal of x, inside F; the two 
Ql\"P subjects represent the truth values xj = and t,- = 1, respectively. 
Each pi must Link to the Subject of its own conjunct ill the logical farm, 
because the subjects are quantified noun phrases- Therefore the pronoun 
/H in the first VF may only [ink to the firat subject [qnp *± = 0] ? which 
represents the conjunct P{xt = D) s and the pronoun j*i in the second (copied) 
VP may only Link to the second subject fq^p i,- = 1]> which represents the 
conjunct F(ij = 1). Aft shown in figure 4-3 above, the verb phrase will also 
contain the construction (18) that represents the nest quantifier 1*4+1- 

The second step is to simulate an existential quantifier. An exis-tentiaLly 
qaanlified predicate [3T;+|i ? (xi+])] is true if and only if [P{i;^i = 0] V 
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P(*i+i = 1)]. The tatter Boolean formulacan be expressed in a construction 
whose surface form is (4S). 



(4S) 




This structure will have two possible mewiimp, as represented by the two 
logical forms in (49): 



(49) a) 




The embedded -sentence represents the predicate P{xi +l ); the embedded 
pronoun p,- +L represent a true literal of i, + i inside the predicate P; the 
two NPs repiesent the truth values x; + \ = (J and s, +q = 1, respectively. 
].ing\U8tJt constraints to be disponed i>3low ensure that p^ +1 cat only be 
llnlfid to one of the two noun phrases, and tbat p, + t can be linked to the 
first NF [mp i, + ] =. Of if and only ii P(3t, + i = 0) is tme^ as shewn in (49a) j 
and that p i+i can be linked to the second NP ( WP x^ = 1] if and only 
if P{*i+t = ]) is true, as shown in (4Gb). The embedded clause will also 
contain the construction (46) tbat represents the next quantifier ¥i l43l as. 
shown in figure 4,5. 

In OTdet to ensure consistency of truth assignments, all embedded pronouns 
representing true literals of Xi+i mast link to the same antecedent. This 
constraint may be enforced using the powerful strong crossover configuration 
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introduced in the previous section. The details of how this- roi,ght be done 
arose front disciI££U»ii villi Alec Maiantz, who suggested all the examples. 

Hecall that Strong crossover is the configuration where an anaphoric el- 
ement a Intervenes between a displaced wh-phraat arid, its trace, and C- 
commands the tract. In such a configuration, a obviates the subject of the 
wh-phrase, 

'a. WJiOi did he.*, say Mary kissed r*,. 
b. [the man]! [whdt he.] like* It], 

The noun phrase in (50b) contain* a relative clause [who fie ftfcw t] that 
predicates [ifi?. mm]; the pronoun Ac is in a strong crossover configuration, 
and therefore cannot refer to [the >mm], which :s the subjecl yf the relative 
y.auye. 

N'o^ consider iiJie efWt of t'Xtraposine; a relative clause containing a strong 
crossover configuration in {51). 

(511 

A- At the airport, a man, met Jane 2 , who fr= i/.j she? likes f t . 

b. At the airport f a manj met Jajiej, who^.-.^ hei like* l*r 

lit (51a), if we understand *ta as referring to i/arte f then we must understand 
who as predicating n men. Conversely, if we understand As as referring 
to a jjttm i]L (5lbJ. then usfto must predicate June. This simple example 
establishes, the ambiguity of predication when the predicate is an extraposed 
relative clause- containing a strong crossover mil figuration- 

When the eXlraposed relative clauae contains two obviative pronouns, as 
in {52), tJietl the sentences cannot have the intended interpretation because 
1 !■.<:■ relative clause must predicate a Subject* yet cannot without violating 
strong crossover. 

(521 

a- *Al the airport, {a man]! met Jajie 2 , who* shez thinks hei likes 

b. *At the airport j (a manjj met Jaiie 2 , whot he L thinks- shej likes 
ik- 

This example establishes that the strong crossover configuration gives rise 
to inviolable obviation between the wh- phrase &fl<J all embedded pronouns 
that c-command its trace, 
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Now we have out construction: 

(S3) At the airport, NP met N"P 3p [who* , , , a. k . , , t^ 

As before, l wo possible antecedents hfp and IS" Pi represent the truth as- 
signments s,- + i = Q and £i + i = 1 5 respectively. Pronouns in the embedded 
clause that represent tune negative literals of ^+1 can only link to the 'false 1 
IlOiliL phrase NPq^ pronouns that represent true positive literals of * 1+1 can 
only link to the ^true 1 noun phrase NP 3 . Observe (hat the relative pronoun 
»Jj*j| may predicate either NPo or NPl in the example (53), The strong 
crossover configuration ensures that all anaphoric elements a in the ejafa- 
posed relative clause obviate the sublet of tlie wh-phrase whe^. Therefore. 
once the ambiguous predication relation is determined, pronouns represent 
ing literals of i;+| must all be linked to the same antecedent because (I) the 
pronouns must all obviate the predicated noun phrase by Strong crossover 
and (ii) there is only One other permissible antecedent by construction. TEds 
exactly/ corresponds to assigning a consistent trutb value to #t+t everywhere. 

The third and final step of the reduction is to si mutate a Boolean 3-clause 
Cj ■ (aj V 6j V Cj) using the pigeonhole principle. A Boolean clause C f is 
true If and Only if one of its literals it true; let us call the literal that sat- 
isfies the clause the wkcifA literal Only selected Literals need be assigned 
consistent truth values: non*elected literals simply don't matter, and can 
receive any arbitrary inconsistent value, Of none at all. We have been re- 
ducing the quantification of variables to the binding of pronouns, and ftO 
must now represent each literal in Ch with a pronoun. For each 3-clause, 
the reduction builds a sentence that contains three disjoint pronouns, and 
only two possible antecedents. At least one of the pronouns ItltlSt be bound 
by 4n antecedent outside the sentence — this pronoun represents the selected 
literal. The following English sentence shows, how this worltE^ 

t 54 ) [a [the student] thought [the teacher] said that 
fhe<j introduced herb to hun^l 

Only two neutral antecedents [ihe student} and [thr tcachej] are locally avail- 
able to the three obviative pronouns ta u1 A«tv and him c in this construction . 
Therefore at least one Of these three pronouns must be bound Outside the 
sentence, by one of tile noun phrases in some dominating cjisstntifier con- 
struction (either (46) or (4%)). This selected pronoun corresponds to a true 
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Li'tral th.it satisfies the clause C-. Agreement features, on pronouns and 
■>..r-\7 anffire^-nl? . iTMin- 1 1 1 ;■ " ;i :to[iou]i rr|:n-v:i'.::r; L': liVrnL n[ ,-, :-, L :i c-i.ly 
Link to an antecedent representing the quantifier of i,-. 

Note thftt this construction is contained inside n/2 VP-deleticn construc- 
tions in the surface form of the entire sentence S, and that therefore the 
corresponding logical form w]ll contain iW 2 copies of each such construc- 
tion, each copy with its own selected pronoun. {This corresponds to (he fact 
that different literals may satisfy a given quantified clause, under different 
quantifier determined (ruth assignment s.) The verh phrase that appears in 
our English example (.54) as [^e inlTWawrf tar te ftinij will immediately con- 
tain the construction representing the next Boolean clause £7j+[, as shown 
in figure 4.3, 

Tic pigeonhole construction representing Cj is permissible Iff ill of its logi- 
cal form copies ire aJ] permissible, which is only possible when the Boolean 
clause C } contains a true literal for any possible ojiantifter*dctermme.d Irucli 
assignment to iu foterfcte, IS represented by the dominating quantifier con- 
structions (either (4f>) or (48 J), Therefore, the logical form for the complete 
surface form S is permissible iff the quantified Boolean formula ft is true. 
□ 

Note that the constructions used in this proof to represent existential qtiari 
tifjers (4&) and Boolean clauses {$i) can be- combined to give a third dii'.-ct 
N'P-hardness proof fur the anaphora- problem, where each pronoun is no 
more than four- ways ambiguous and no elliptical contexts a.ie used. Such a- 
proof requires significantly fewer agreement features than used in the proof 
of lemma 1 .1 . 1 . 

The epilogue to this proof 1* i demonstration of how the preceding reduction 
might concretely represent the QBF formula Vjl#[(p V J? V JrJ, ( x V r V y}\ in 
an actual English sentenc*. 

There are two minor difficulties thai are entirely Coincidental to the English 
language: the English plural pronoun they is unspecified for gender; there 
are uo entirely neutral arguments in English, tha-t cin be the antecedent of 
any pronoun, Rather than construct our example in a different language, 
say Italian, let us make the following allowances. To overcome the first 
difficulty,, let theya he the masculine plural pronoun, and fttjt\, the feminine 
plural pronoun, To overcome the second di:iicjl:y, we observe that a. [ilunil 
pronoun can always have a split antecedent, as in example (55), and thai 



35 



the condition of local obviatfon holds between Ihey and ftim. Thai is, (ftejr 
and. fttm cannot share an antecedent when they arc locally obviatjve. 

(55} Johlli Suggested to Tcusi? that they.-,^ tell hin-^i^ to leave. 

We will usb split antecedents below. 

The given formula has two variables, x and y, wbkh we will identify via tin? 
plural/singular number distinction; plural pronouns represent literals of r„ 
while singular pronouns represent li terals of y . Negation will he represented 
via the the masculine/feminine gender distinction: masculine pronouns for 
negative literals, feminine pronouns for positive literals, These correspon- 
dences are summarized in the table: 
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The constructed sentence consists of four compon^ius: 

■ The Vp^llipsis construction (A&) to represent Vx: 

(56) [[NP a *Oma stewards] [ VP gay ( 5 L . , ]]] 

and so do [[np t some stewardesses] [yp *]] 

• The evtrapused strong tttotsaw configuration (53) to zejmsHl 3p: 

t3f ) [ £ at the airport f a a KGD man] met h Jane], [* who k [... i t ] 
and [. . , h}) 

* The pigeonhole construction (54) to represent Q ViVj) using spljL 
antecedents. 

(*5) [s the officer, the agent, and the mechanic suspected 
[heo expected lhem to talk to her]]] 

There are three locally available antecedents, all singular and unspec 
Ified for gender. The three pronouns in the embedded clause are ob- 
Viative, and require at least four singular antecedents. Therefore, at 
least one of the pronouns must be Linked to an argument outside the 
construction (5&). 



• A second pigeonhole construction to represent (z V x V y}* again using 
split antecedents. 

(Sft) [ s the crew, the pilot., and the co-pilot knew jthtyt traded theimn 
toherj 

There are three locally available antecedents: one is plural neuter ',i f ;( 
cneic), and the remaining two are singular neuter. The three pronouns 
in the embedded clause are obviative, and rcqtiirc at least one plural 
antecedent and three singular antecedents. Therefore, at least one of 
the pronouns must be linked to an argument outside the construction 

The result! nc, sentence, in all He glory> is: 

(60) [[^p^ some stewards] [yp say 

[s at the airport [r. iy KGB iuiu:] [net fi Jane]. [$• who* 

[5 the officer, the agent, and the mechanic suspected 

[hea expected ihemij to talk to hen about Ct]] 

and 

[js the crew, the pilot* and the co* pilot knew 

[theyt traded therruj. to her] for £*]]] 

and so do 

ilNE*, some e tewardeBEes) [vp- e. 

This concludes Ike presentation of the lemma 4.2.1. 

4.2.3 Ellipsis reconsidered 

In the previous section, we proved, that the anaphora problem is PSPACE- 
hard. The thesis we Are- defending States that language COinpiehension is 
NP- complete. Therefore, the thesis predicts that there Is a defect in the 
linguistic analysis tLa k<j lp, tha E^PACC-hardueas r*siik, The thesis also 
toll* Us exactly where to look for the defect: we must reexamine that part 
of the analysis that allowed us to simulate a computation oucside of Jv'P- 
In the case of a. reduction from QBF, the defect must h<f in that paxt of 
the analysis used to simuSatc the unnatu rally powerful universal quantifier, 
Therefore, let us reexamine the copy theory 4.1 of ellipsis. 
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A copy operation naturally makes two pred i ction-S; neither holds. 

The first prediction is that the original (overt) structure and. its copy will 
Obey trie same post-copying linguis-tic constraints. including agreement acid 
the linking conditions. (If agreement and the linking conditions did not 
apply after copying,, then it would always be possible to vacuously satisfy 
those constraints,, simply by postponing all linking until after spying bad 
applied, Therefore, agreement and the linking conditions must apply both 
before and after copying.) This, expected post-copying equivalence is vio- 
lated. Although overt pronouns must agree with their antecedent On gender 
and number f.&Ia), .copied pronouns can disagree with their antecedents, &j 
in (61b): e 

f filli 

*, Tomi read hLs l /_ a hook and Barbaras ™*d h'\$\./*z oook {too). 
b. Tortl] (read hi&i bool| and Haj-r>ara 2 did !e] too. 
[[read tti$ tfi book]) 

Moreover* although overt anaphors must have lo^al antecedents in (62a)> 
copied anaphora need not, as. shown in (f>£h): 

The prisoner] shot himself before [the exfif utionerj cou!d shoot 
himse|f il/2 J. 

a. The prisoner [shot himself,] before the eseeuticnerj could [c]. 

[{shoot In:.;. <■■<>{. . .j j 

The second prediction j* that processes that apply afttr copying, such as 
linking, will apply independently in both the original [overt] stfnctnre and 
its copy. This, expected post- copying independence is also violated, In par- 
ticular . li n Lj rig is not i n d epen dent in both the original structure and its. copy , 
as shown by example (&3)< which is incorrectly predicted to have five read- 

TTiedidicuJljf of Qbthlnuis ih. e cc,vki\*m interpretation fat Barbara, ™d fcrr, i™* itnd 
£nc did («, ar Jar MV, »te „ vri H y*<3oto arid' ts > did Jlah, d M „ a uL ™icn ttir aificum 
at Uic r.npj tli«wjf 4.1. My uriEirijm is hi«d. ™ tJi= *r.c**<,\ly of diKripiiiutinB; (&lj,> 
tad (6]b>, which the cajv/ theory is unable- Lri do. Id <wd« <■- ar<-c U j,i Ear ll,f^ feeble 
ib.*njLanL*-cav*ii*ni contra*:. be?w«Q mamniin* 4BUJ feraiaLiw pTO&Oiicu. wn ssgjMi in 
4PtMndi* H Lhit lK e ihsmilk-pobiTJnna a5Hg;ni:d :o KMrm atiaptcTir de/dent* n- wi|] JnlitnL 
the ^gt^rjient featured of cr. and in th*s* ewe* a muil ijr<t! mtb both of it* an t««teii i S. 
An a]1*rn<U<; aypruach, Lrj e , T thai fc* L* thr "d^£*nLt bound ^tkbLc," ■m M lJd incDnKllv 
Hoggesl that thr ravariaat imwpretatiDn nf *ht is nerer aviJabk, 
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jrjgg {two when, linking precedes copying;, four when linking follows copying, 
and one overlap). 

(63} Bob [introduced Felix to his neighbors] and 90 did, Mw [(?]. 

Id particular, there should be a reading where the overt bin refers to Fete 
and the null /copied ftis refers to Max. However, this reading is ni>t avftilablb. 
In fact, only three interpretations of (fi3) are attested (two invariant one 
covariant), at shown in (64): 

r fi -1 l 

a. Bob l [introduced Felix; Lo hisj neighbors] and bo did M&Xa [e], 

([trtfroJurtrf /Wi'xj t& his.iftf.3 neighbors]) 

h- Bobi [introduced Feu*? lo hist neighbors] and so did Maxj [e]. 

{[introduced Fclixi to A3s l ^. 2 y :s nci^Aior-s] ) 

Id other words, a pronoun must lini Lo the same position in both the visible 
wb phrase and He understood copy. This is not real Copying, but a hind of 
logical predic.ate-sharini; f .Jiat can always be represented withou*. copying. 

Let us therefore propose the following predicate-sharing theory 4.2 of ellipsis: 

Theory 4.7 The loQicat /nrtu of ellipsis t.i- constructed bu sharing the same 
thematic predicate txtteeen the overt, and tlhpmi ^rtjcrtJAes; o foliation is a 
relation between argument positions in a thematic predicate; an anaphoric 
■lt-.:t:.! :,'r:iy i'l':.'- :« .i:. fjryrjn.-i nf r.r ,',.• rm ■t:Y 1 "irniTL? t)0.f:!;f-;i. 

EvidftTVC*. I":. ■'. Mi::.-; ;,n ll -:" 1 1 . =i ' ;■ I" i - 1 1- 1 i :ii^ "i:i::. -.:u-li ..iin-i r \: i c i ;;.: : rivl 
ohjects to a verb phrase; a veTh phrase js function from the inflection and 
the subject to a logical proposition, tna*- ■<■ realized syntactically as aclwis*. 
For example, the expression Felix hates vegetables would be assigned then 
logical form {G5)- 

f 6i) [At.[x hates vegetables] ) ( \P .ft Felix P)] ) 

Second, VF-ellipsi* is the sharing of one VT predicate between two clauses. 
One way to represent the logical form of an elliptical structure to lambda- 
abstract the VK predicate. For example, the surface form (fioa) would be 
assign^ the lojiical form representation (66b}r 
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a. [Felix (ate dinner]] and go did [Tom [e]] 

b. I'Aj-,:* aLe dinner]) (AR[(F Felix) ajid so did (p Tom}]) 

Third, obviatjori is a relation between tJLC argument poaitinnn in the VP 
predicate, as illustrated in (fi7b) for the surface form (u7a), 

a. RomeO] v/ajits Rosaline to [lovs htiii T |] before wanting him*«lfi 

to (*]. 
h. (i^i-'x. 1.0 love hircuij) 

(AP^Romeo, want* ((Rosaline P)] hefor* wanting [(himseLfj 

^)H) * [* 5< J] 

This logical form representation accounts fof all the cases of invisible obvi- 
aliOB, without an unnaturally powerful copying operation, 

Fourth, an anaphoric element may link to an argument directly (68b].. re- 
sulting; in the invariant interpretation,, or indirectly, to an argument position 
in the VP predicate (68e), resulting in the covariant interpretation. 

a. FeliK! (hates Isisx neighbors] and to dose Max [r] 

b. (Ai.[j bates his, neighbors]) (Ap.^FeliX; P) and (Max P}]) 

c. (A*{.|xj hates his* dinner]) (AP.[(FUix p) ud (Max P)]) ' 



This predicate-sharing theory 4.2 correctly predicts that the example fffl) 
has exactly three interpretations, one for each, of the three possible verbal 
predicates shown in (65), 

' li'-V 

a. (Xx,\i- introdnoed Ffclix to Felix's neigh horsj) 
[XP.[(P Bob) and(P Max)]) 

b. (Aar,[:r introduced F^lix to x's neighbors]) 
(AP.ftP Boo) and (J* Max)]) 

C (Ax.\x introduced FeLix to Bob's neighbors]) 
( A P-[(P Bob) and {J 3 Mas}]) 

While predicate-sharing is conceptually simple, an extensive investigation. j$ 
needed to confirm Siicb a linguistic theory, This, is the task ol appendix B- 
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The predicate-sharing theory 4.2 gives he the upper bound, predicted by the 
complexity thesis; 

Theorem 10 J"nrf anaphora profrfc-m is in JiS"P far nonetlipl teat structures, 
and for elliptical structures with prztiicatG-tfhariny. 

Proof. Covert arguments in a structure are either coreferential with an 
overt argument in the structure (for example, control PRO OT wh-trace), in 
which case the they may be coalesced with their overt antecedent-, or they 
ire assigned an arbitrary interpretation (PRO^i,). in which case they do 
□ot participate in the graph of referential dependencies and may be ignored 
entirely. There-fore, the- number of ohvj*tjon relations ia at most quadratic in 
(he number of overt arguments, an upper bound that is obtained in the case 
of a complete obvjalion graph, The logical forms licensed by the predicate- 
sharing theory 4.2 are nearly the same size as their corresponding surface 
forms, because we cast always Lam h da abstract the shared predicate, if the 
Structure is elliptical, Otherwise., the structure is nonellipticaJ and logical 
and surface forms, are the same size, hecause operators that map surface 
forms to logical forms., s-uch as quantifier scope assignment, do Dot increase 
the number of arguments and therefore cannot increase the size of the graph 
of referential dependencies beyond quadratic. Next, each anaphoric element 
is nondetenaiaislicaJly Linked either to an argument in the set A t>f invaila'^e 
antecedents, or to an open thematic, position. Clearly this may be done 
in uondeterministic polynomial time. Finally, we eh wit that the linking 
conditions ait satisfied, including invisible obviation. In deterministic time 
proportional to the number of links, verifying the semantics of ohviatjop liy 
propagated "referential value 11 markers along the links, checking for cyclic 
dependencies, Mid SO forth. □ 

Theorem 11 The anaphora prohicm is HP-complete* 

Fnoofr By theorems 10 and £). Q 

As *e saw above in section 4.2-3, and a^ain in greater detail in appendix It, 
the predicate- sharing theory is strictly superior to the copy-and^nk theory, 
That is, the predicate-sharing theory assigns better structural descriptions 
to the class of elliptical utterances than the ropy -and -link theory does, and 
no utterances are assigned better strucluraJ descriptions by the copy-and- 
link theory. However,, the significance of the predicate-sharing theory goes 
beyond merely the number of linguistic examples correctly reclassified. 
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Recad] thai our central scientific goal is to understand the comprehension,, 
induction, and aequisi^on of human language; generative theory is inter- 
esting only in so far as it advances this goal. The solution to a FSPACE-b&rd 
problem may be exponentially Large ill the -size of the problem statement. 
{ Unlike problem in A'P, PSPACE-hard problem ,s do not have efficient wit- 
nesses. An efficient witness is a short correctness proof for a solutLofl. In 
the case of the anaphora pr&hiem, a permissible graph, of referential depen- 
dencies serves as the correctness proof.) If anaphora comprehension were 
PSFACE-hard, as it is according to the ccpy-and-link theory of ellipsis, 
then the mental representations required to produce and comprehend ellip- 
tical anaphora would, be infeasibly large. Language users could not even 
comprehend the utterances that they themselves produced. And the gen- 
erative theory of amphora would not yield a plausible account of language 
corn prehension and production. 

Bat by reducing the complexity of anaphora from PS FACE to AT, w* prove 
that the anaphora problem has efficient witness^ and in turn show that gen- 
erative theory is the basis oJ a plausible account of anaphora comprehension 
and production. 



4,3 Analysis of linguistic theories 

It is informative to contrast Ihe approach of this report, the direct analysis of 
human language, with a related approach, the analysis of linguistic theories 
Ill the litter approach., we study the theory-internal computational problems 
posed by the theory, such as, "compute this predicate defined by the theory," 
or "ensure that this constraint of the theory is satisfied, " Chapter "l has 
examined the computational structure of generative phonological theories in 
some detail. This approach is also exemplified by Giorgi, Pianesi. and Saita 
(1989) in their complexity investigation of the binding theory of Chomskv 
(WW). 

The central danger of such in approach is the risk of irrelevance,, which in- 
creases whenever we lost* sight of the computation*] problems of language 
comprehension, production, and acquisition. Different theories talk about 
vastly different things, and hence r is im^osKiblf to achieve m >, idnd nf 
invariance with respect to either phenomena Or theory. Moreover,' thd com- 
putational properties of even the perfect linguistic theory have at best an 
indirect connection to the computational properties of human language 
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The central computational problem posed by all generative linguistic theo- 
ries, of which aJl theory-internal problem* aresuhproblems, is to enumerate 
all and only the possible structural descriptions (that is. possible linguis- 
ti-C representations}. That is, linguistic theory itself pones a computational 
problem, the piobiem of constructing the tth representation in the enumer- 
ation, gjven (he index of enumeration i. (EquivaJentty, we may think of i as 
the encoding of a possible linguistic representation that must be v^fBHed. by 
the linguistic theory as heing permissible.) As elaborated in chapter 2, the 
iumput*tioiLa] problems of enumerating or verifying representations have 
al best an indirect connection to human Language, which is the process nf 
constructing structural description* of evidence. 

Even worse, complexity analyses of linguistic theories are likely to be ir- 
relevant. For example, consider the many different theories of referential 
dependencies. They are stilted in vastly different terms;: as constraints on 
syntactic or discourse-level representations, in terms of the goals and inten- 
tions of speakers and bearers, or even in terens of the. objective ""meaning. 11 
of utterances in relation to the external world, Let us examine three very 
similar theories of anaphora, that nonetheless have widely divergent corn." 
plexites. 

One approach requires all referentially-dependenl elements, including pro- 
nouns, to have Linguistic antecedents If at all possible (Higgmbotb&m 39S3. 
t>r at kftst its spirit). Tin? theory-intern id computational problem posed by 
such a. theory is to link every pronoun to an argument, subject to condition? 
of ohviatioii and acyclicity. As proven in this chapter, the decision problem 
posed by this approach is NP-compIete. 

A second approach postulates a condition of chelation combined with free in- 
dexing of all argu ments (0 horns ky 1 9 56] . The correspond in g theory-internal 
problems posed are {i) to dfside if a given indexing is permissible (verifica- 
tion) and (ii) to ensure that pronouns may indexed without violating the 
oUviation condition (satisfaction). The verification problem is r.lftariy easy, 
requiring US to simply compute the obviatiun relations from the phrase struc- 
ture and check that earh pronoun is assigned a different ine>x than any of 
the arguments that it obviates. Because obviatlon may always be satisfied by 
trivially assigning a different index la every pronoun, the decision problem 
for satisfaction requires constant time., that is, always answer YES. 

A third approach Only handles case-e of so- called bound anaphora, where a 
pronoun is interpreted as a variable bound by a quantifier, as in Jewry man] 
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ate hw rfiimrr {Rein hut I9S3). The theory- Intern^ veri fi ration, problem 
posed is to Ciliure that every pronoun interpreted as a bound variable is 
e-cornirianded by a natural quantifier The problem of checking an existing 
structure is efficient, requiting time proportional to the size of the Struc- 
ture, However, even when every pronoun is required to have a linguistic 
antecedent, no pronoun need ewer be interpreted as a bound variable,, and 
hence the corresponding decision problem for satisfying Reinhart's theory 
only requires ton stint time. 

But the theory- internal problem* corresponding lo the second two approaches 
aie of no independent interest, being entirely irrelevant to human language. 
In studying the computational structure of human language the Only re], 
evant problems *re language comprehension, production, and acquisition, 
The computational problem posed by pronouns tn the act of comprehension 
19 to compute their antecedent? using no new information, If language user 
fails to do this, then lie has failed to comprehend either the pronouns or 
the utterance that contains them.. The fact that a language usei can fail to 
comprehend am utterance in constant time by assigning it an inadequate or 
incomplete representation is of no interest. 

Even if Our sole interest is in the computational structure of Linguistic thco- 
tk-s. I hen we should still study the complexity of LC problems. Study ing LC 
problems allows us to more easily compare linguistic theories, and to study 
the complex interactions among the different parts of a linguist jc theory, 
Either a particular LC problem LS posed by a particular linguistic theory, or 
it is not, IT 31 Lb not posed by the theory, then that theory is empirically in- 
adequate, and we understand exactly why and how thfr theory is inadequate. 
Otherwise the LC problem is posed by the theory, and no matter how it is 
pc*ed by the particular theory— no matter how Lt is disguised or carved up 
into different parts of the theory, whether in phonology, syntax, discourse, 
pragmatics^ semantics h or what have you— then that linguistic theory inher- 
its the computational complexity and Structure of the LC problem, This is 
because complexity theory classifies problems, not algorithms or particular 
ways of solving those problems, As long as a linguistic theory poses all LC 
p:robtcin H the problem of assigning representations to utterances according 
to that theory is at least as complex as the LC problem js r 

This is well-illustrated by the anaphora problem studied in this chapter. 
As long as a particular theory of language has an empirically adequate de- 
scription of the observed facts of obvialion and antecedence, then the com 
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prehension problem for that IbgiLl&tJt theory itthcrJta the UtructUM of the 
anaphora problem examined here. This is true no matter how this descrip- 
tion is couched, whether in -.eims of constraints on a. s y :LtiU'tic rel&titift of 
coindexins or Linkhie, i:i terms of Syntax or discourse, in terms of spealiflp- 
bearei intentions or cither pragmatic considerations* or even Lil tends of a 
Montague- like compositional theory of semantic types. If the theory pro- 
vides an empirically adequate description of the Iwipiage user's knowledge 
of utterances, then it will inherit the inalienJ&k computational Structure of 
that kinMvledge, 
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Appendix A 

Philosophical Issues 



Id this chapter, w$ examine two philosophical issues arising from tie research 
described jjj the body of the report. Firsts we consider the imputations 
of an NP- completeness thesis for human, knowledge. Next, wc discuss the 
idealisations to unbounded inputs and unbounded distinctions, which have 
played an Important role in the complexity analyses. 



A>1 Implications of a complexity classification 

What ate the implications of placing human language in the abstract hi- 
erarchy of computational complexity? And what is- the exact significance 
of proving MP lowif bounds on Language- Com prehension /production? The 
consequences of out thesis, l.liu: Lan-roac^is .m p complete, are hoth prac tical 
and theoretical. 

The central theoretical consequence of the NP- completeness thesis is to of 
fer a broad new (and very different) perspective on human language, ^here 
things previously obscured now become clear. By placing language in the 
ino.ch-stu.dled complexity hierarchy, we better understand it's overall COin- 
putationai structure* by analogy to the other equivalent Combinatorial prob- 
lems in its complexity class. Wc see that language computations arc not like 
tWvperson adversary games (PSPACE), nor are they like pointer- following; 
(LSPACE) or directed search in a feasible space of possibilities (p), Rather, 
human language is like blind search In an exponentially large space [ r Vp)] 
CO find efficient witnesses. 
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An second (indirect) theoretical consequence of the thesis has been to refute 
the linguistic theory- Itl order to carry out a direct complexity analysis, 
we must present strong empirical arguments about the facts of linguistic 
knowledge. Each direct analysis in tins report has improved on current 
understanding. In chapter 2, repeated complexity analyses led us to reor- 
ganize the overjgeneral architecture of segment aJ phonology, expose (for the 
first time) the unnatural rule interactions ailowed in segmental model, reveal 
the import ir.ce that the mt 1 L Ik<o! ■ »gi i" al ■iirective ^ornit directly-predictable 
i f .-■-■:, 'ioi " :l.\'.f. in pi:o:ir.-.-.)ei:-.nl prvi ■■;!-■?■. ,i nl increase our .1 -i-i >; i:-r .^,,,1 
ing of the SPE evaluation metric. In chapter 4, we falsified the Standard 
npndistijictness theory of anaphoric agreement and elucidated the grammar 
of referential dependencies. Next we discovered the phenomena of Irt^iSL- 
ble obviation,, demonstrated the necessity of revising the binding: conditions 
accordingly, falsified the widely-accepted copy-and-hnk theory of syntactic 
ellipsis, and proposed an alternative predicate- shading theory that is strictly 
empirically s-uperior (as shown in appendix B). Each discovery arose natu- 
rally out of the complexity investigation. 

We may also ask, what are the real- world implications of the AT lower 
bounds for natural langnage parsers and for theories of language processing? 

A parser is an algorithm that assigns -structural descriptions to linguistic 
expressions,, according to a linguistic theory that is typically represented as 
a grammar. An expression is. a string of abstract symbols, typically words 
and occasionally morphemes. A parser is correct if i' assigns to every input 
expression exactly the structural descriptions that the generative linguis- 
tic theory does. Given our current understanding of non determinism, th-- 
\P-hardness of language comprehension means that correct natural lan- 
guage parsers require an exponential! y-iiLcre&silig amount of time to parse 
expressions of linearly "increasing length. In short t correct parsers mtMt b* 
intractable. (This empirical consequence is nothing new] the intractability 
of existing parsers is well-documented.) 

A theory 1 : r " .1 1 guagf processing in an exp^icr, ccmpuUi-lkn^d ilKide] :f r hi 
language user., that attempts to explain {or at least describe) the compre- 
hension, production, and acquisition of languages. Sometimes such a theory 
is called a performance theory h Or a theory of sentence processing, The 
complexity analyses in this report demonstrate conclusively thai the relation 
between cjampf-ttncf. and performance, between a pfliieruziiM thaary and a 
theory of proczs$tn$, is not one of limited ability. This Tact is contrary to 
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the frequently expressed and widely held beliefs of linguists t psycholinguists, 
and computational Linguists. If Linguistic performance in-as the limited abil- 
ity to whs linguistic competence, then Ivo consequences would accrue. The 
first is that lanpuiRe users would have difficulty p;ocessing those utterances 
Hiat are truly computationally difficult- The Second is thai language users 
should not have difficulty processing computationally trivial utterances, 

There ate infinite classes of sentences that may be easily parse J (that is, 
assigned correct structural descriptions by a simple and very fast algorithm }, 
yet these sen-.enr^s are extremely difficult for language users to process. 
One such class is those sentences with trivial ubviatlon graphs, such &■> 
complete or edge- free graphs, Computing the referential dependencies for 
*i.ic1l utterances is trivial, yet language users cannot do it, (In fact, they 
appear to have difficulty processing utterances with multiple antecedents, 
regardless of the obvjation relations ini'olved-) A second instance is garden 
path sentences, such as the horse raced jm.*( tti* Ixtm fell) which are quickly 
parsed hy simple algorithms, yet seem extremely difficult for language users 
to process.. 

There are also infinite classes of complex sentences that cannot he efficiently 
parsed hy any known algorithm, yet these sentences are processed effortlessly 
hy human language users. One such class is sentence^ containing rr.anv Jo 
cal ambigtiitic-fc,, Such as lexically ambiguous Words. Moat sentences are in 
this class, and 130 language user has any difficulty processing Ehem. How- 
ever, such sentences bring current parsers to their knees, because it is not 
known how to correctly resold lexical ambiguities locally* without build- 
ing a complete Structural description and therefore being forced to examine 
*J1 exponential number of possible parses. A second instance is utterance? 
Understood aa containing phonoloflKally covert elements (so-called empty 
categories, Such as as traces or FRO ). TVteeling empty categories and com- 
puting their antecedents is extremely difficult for parsing algorithms, but 
effortless for humans. 

It is not at alt surprising that attempts to explain So-called "performance 
limitations" .v. resource- bounded competence have all failed. One fixed re- 
source hound is never subtle enough to cap tare the diverse range of observed 
empirical facts, [n order to have explanatory force* a small number of re- 
source bounds must be postulated tr> explain a targe number of seemingly 
urn related performance Limitations.. {To postulate a different resource bound 
for every Construction is merely (O restate the performance facts,) To my 
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knowledge, no omfi ht+i\ able to explain a tiuly diverse ranp*e of performance 
facts — say from the phonoloe^y and synt&Jt, « Involving both refereutial de- 
pc-ndeneies and phrase structure— using ooic resource hound., although many 
have tried. Nor lias anyone successfully described even St similar set of per- 
formance facts using one resource bound, This may be seel in the work of 
Miller atld Chomsky (1963), who attempted to calculate a numerical bound 
on the depth of acceptable recursive phrase structure embeddings. However 
their work only served to demonstrate that no fixed bound could he found 
fox tie few constructions they examined, even in in the limited domain of 
phrase structure compulations. A second example cftmes from tie numer- 
nns failed attempts to explain gardm jm thing ^ the inabdily to properly 
resolv* a local ambiguity in phrase structure, alt*chmeilt- The central diffi- 
culty in such an endeavor it to explain why some types of local ambiguity 
• !.s.li;_i:!-:r : ..- f ...,.i ..,-., v\ .iji.;- ^hts don't, aiWi *-K .Kli:haJ utibL&uJlJC: ■.-- 1 , i -"n 
should always be more costly) do notr ft js not known how to resolve Such 
contrajdictinns. 

Even worse, an account in terms of rciOuJCe limitations bas never been 
plausibly motivated, that is, shown remotely relevant lo human language 
processing. A theory of resource utilisation malies, exactly one fundamental 
prediction: that the resource-consuming process must for some input at some 
critical point exhaust the available resources, at which point the process 
will crash. Those inputs that exceed the critical point wilt he lejected, even 
though they are very similar to other inputs that do not exceed the critical 
point. In order to demonstrate the plausibility of an explanation in terms 
:,', n:-';.-.- 1 :■■■<■■ l:rr.'.i.s, somcur/.' ]:nM *■ )*■ I "hir (!x?.mpks cr. bulli s:dcs of such .1 
critical point, This has yet to be done. 

Nor can performance limitations be explained as errors in competence. The 
language device cannot be said to make systematic or pervasive errors, be- 
cause suck errors can exist only with res-peci to a designer's intentions or 
goals.;, and the language device was not designed- fn short, systematic *er- 
rors* cannot be errors in performance, only empirical inadequacies of a par- 
ticular competence theory. A real performance erf or, then! must be inter- 
mittent and unexpected r And tf &Uth errors are not to be accounted for 
by the competence- theory, ai j* wi^jy. assumed, then tkey cannot logically 
constitute evidence Cor or against the competence theory. Thia is exactly 
the a priori segregation of evidence into relevant/ irrelevant that Chomsky 
( \#&6) has so powerfully argued against. Empirical evidence for or against a 
scientific theoiy might- in principle be found anywhere. Linpiistics is no dif- 
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ferent: tLe one scientific theory of human language musE explain performance 
errors, because such triors are relevant evidence for the theory. Language 
error* cannot have their own scientific theory. To see this, Consider Becker 
(1975) > who shows how the i □ dependent tiers of the aulosegmenta! model 
can explain facts about speech errors such as that "when vowels or syllables 
or parts Of syllables or whole words are substituted r>r f raTLSposed t there is 
no change in the stress contour of the sentences.'" (Franklin t lS71:-ii2] 

What is the relation between a generative theory of linguistic knowledge ami 
a constructive theory of lauguagen that explains comprehension, production 
and acquisition? It seem& to me (hit a constructive theory will result front 
the generative theory under the informa Lion- theoretic interpretation (out- 
lined in chapter 1}, refined by increasingly subtle principles and limited hv 
the current state of acquisition. Kmplrieal facts thought of today as perfor- 
mance limitation 3 will bd explained tomorrow eithec as interact ions among 
the refined linguistic principles, or as the incomplete acquisition of linguistic 
knowledge. 

Some so-called performance [imitations will he understood as the interac- 
tion of increasingly .subtle Linguistic principles. One such in account is due 
to FrLtchett (I&fiS), who explained garden path construe dona in terms of 
invariants, in the computation of thematic structure. A second instance is 
due to Idsardi (I9B&), who accounted for a. Tange of classical performance 
limitations (PP attachment ambiguities,, garden paths, said multiple center 
embeddings) in terms of a linguistic constraint on the mapping between a 
syntactic relation (government) and a phonological structure (the intonation 
phrase). 

A second (more powerful) class of explanations may be obtained by thinking 
of the generative theory as the theory of acquirable structural descriptions, 
and performance limitations as temporary > accidental Limits in the current 
state of acquisition. On this view, language user* learn how to pair ut- 
terances with their permissible structural descriptions only after repeated 
expos lire to the relevant evidence. Let us consider some examples, The 
naive language user does not easily recognize the ambiguities inherent in 
many Utterances, such as ambiguities in lexical choice or quantifier scope, 
but Once these ambiguities are pointed nut and successfully acquired, they 
are effortlessly detected and produced in novel utterance*. Other exajti 
Jilts f.ime from constructions on the frontiers of linguistics research, Such 
U parasitic gaps;, strong crossover, and ellipsis. Language users have great 
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difficulty comprehending these constructions on their initial exposure. After 
repeated exposure however, these constructions are easi] J" comprehended,. 
We 'would say that knowledge of the binding conditions is innate, but that 
the Language user must acquire anaphoric morphemes and lesun how to com- 
pute antecedence andobvLatJoft in particular structural configurations, such 
ai strong crossover or ellipsis.. A third clans of examples, such SB center 
embedding; and garden f>*ths, comes from psycholinguistics- Although it is 
seldom discussed, the most striking fact about these constructions is that 
after sufficient practice, the language user no Longer lias difficulty processing 



A. 2 Unbounded idealizations 

A central assumption in this work has been the idealisation to an unbounded 
number of input instances, computational resources, and Linguistic distinc- 
tions. These 'unbounded idealisations, 1 from a finite set of finite objects 
to an infinite set of finite objects, ate as central to linguistics as they are 
to computer science. Generative linguistic theory and theoretical computer 
science make the same idealisations to unbounded inputs and computational 
resource* bees-use they result in the best explanations and empirical predict 
tions. 

The first idealization, from a necessarily finite set of inputs Lu an abstract 
infinity of inputs, results in better linguistic theories, finite sets may be 
characterised i>y simply listing their dements or by bounding a finite char- 
acterization of some infinite superset. The latter idealisation to an Infinite 
set gives us a simpler ,, more predictive, and mote interesting characteriza- 
tion th&tl any simple listing could. The idealisation to un bounded inputs 
gives (is potent insights because il ift.essitates a finite characterization of an 
infinite set, which is only possible If we have d isooverad significant structure 
in that set, 

The second idealization, from a class of computation* that each uses a finite 
amount of Lime am! spar* to infinite computat]onal resources, is central to 
computer science: u To properly capture the notion of a computation we need 
a potentially Infinite memory, even though each computer installation Is fi- 
nite.'" {Hopcroft and UllfliM, 1979:14) In linguistics, Chomsky (I960) and 
others have convincingly argued that human language Is not a finite state 
system l despite the empirical fact that language users have only finite ca- 
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pahilities. Although every linguistic computation only uses- a finite amount 
of resources. viewing an mam language as a finite state- system— as a compu- 
tation whose available resources are bounded by a fixed constant — doe? ft&t 
give us the most explanatory linguistic theory. 

in. general, we make- Idealizations to simplify the i]:L[jQysibly complex real 
world, and therefor* idealizations are never subject to direct empirical c^n- 
fiimation. An ideal! aa-tion is justified only if jt resuLts in the beat scientific 
theory, with the best explanations and predictions, not if it is true or not- 

Consider tin] Newtonian idealization to point masses. Clearly, it is em- 
pirically falser there ha? never been a point mass, nor will there ever be- 
However this point- mass idealisation is useful because jt simplifies the- com- 
putation of interactions among massy object? without distorting the out- 
«rJH Of that computation. Ffowevef, when two objects are very close, or 
when the computations ate very sensitive., then the point- mass idealization 
hreiJfR down, and must therefore be- abandoned. The sole justification of 
an idealization is its utility: arguments about the a priori plausibility of an 
idealisation, although perhaps persuasive, are not ultimately relevant. 

Unbounded idealisations are- no different. In this finite worldj there will 
never be an infinity of anything- However., the idealization to an infinite 
set of finite objects (an unbounded idealization, hereafter) can be an ex- 
tremely useful simplification of a finite set of finite objects whose size can 
vary. An unbounded idealization is especially useful when the infinite set 
Is bounded by an order- of-growth function in some natural parameter. For 
example, in order to restrict the amount of resources used by any given 
computation while preserving the idealization to infinite resources, we can 
bound resources by a function f(n) in the input length n. Thus, although 
4 /"(nj-resource bounded Computation in principle has access to an infinite 
amount at computational resources, jt may 11** no more- thaq /(n) units of 
a given resource on any actual length-™ input. Crucially, in an unbounded 
idealization, although objects can be arbitrarily large, each object is finite. 

The idealization to an Unbounded number of linguistic features is no dif- 
ferent from any other unbounded idealization, features ate a method of 
representing significant distinctions, where eajch feature- represents an inde- 
pendent dimension wherein elements can differ. (The relevant parameter 
is the number of significant fJistJnct!ons 1 not the number of features.] The 
unbounded-feature idealization does not claim that a language user is ca- 
pable of making an infinite number of lingucs lie ally-significant distinctions, 
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Hither, it claims that language users arc best seen as being capable of mak- 
ing any finite number of distinctions because the number of empirlcally- 
observed distinctions is quite lar&e and v&Tiea fiom language to Language, 
and even from language user to language user. In fact, linguistic features are 
intuitively equivalent to computational space, and therefore the unbounded 
feature idealization is properly i nd tided in linguistic theory's unconlfoversl a) 
idealization to infinite computational resources. 

The goal of a complexity analysis is to characterise the amount of time and 
spate -needed lo Solve a given problem iii terms, of all computationally rel- 
evant inputs. Therefore, the unbounded-feature idealization is justified on 
complexity- theoretic grnuncs if I tie number of linguistic features, affects the 
.:!!: |ili-:<i r > ;lf ?. I i n Er^llu L i :- |!i-:>"iT.StiS r-'.lfii as ki.ilguiigf COrr.pid.--r --"1:1. 'I'll' 
proofs in this report conclusively establish that the number of significant dis- 
tinctions is a Significant parameter of the complexity of a linguistic process 
and therefore the idealisation ia justified in the framework of complexity 
theory. 

A central goal of linguistics is to characterise the productive portions of our 
hnguisiic anilities. Therefor^ the unbounded- feature idealization is- justified 
on linguistic grounds if the number of linguistically-relevant distinctions is 
productive. A set of linguistic objects, such as Lhe set of lejdcal entries, is 
productive if the set is uniform f variable, and large. By vrcijovrn, I mean 
that linguistic process are not sensitive to the exact size of the set, nyi is 
each member of the set associated with its own Idiosyncratic processes— 
rather j linguistic process apply uniformly to a significant subset of the set. 
By variable, I mean that the nurnher and type of linguistic objects varies 
from theory to theory, language Lo langi.iis.ge, and even speaker tr> speaker. 
By AiTC, I mean that the set of linguistic objects is not restricted to a 
handful of such objects. If (lie set of linguistically- relevant distinctions is 
uniform „ variable, and targe, then it is linguistically productive. This work 
mates unbounded-distinction idealizations for two different dass of features: 
syntactic features arid phonological features. Let us consider each in turn- 

A.2.1 Unbounded agreement features 

The sat of syntactic distinctions is uniform—that is, syntactic features 
are not associated -with their own peculiar Idiosyncratic agreement process, 
fundamentally different from alt other agreement processes, In the linguia- 
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tie. theory of g*Tit:fxtliz*il phn^e structure grammar there are only three 
(overlapping) classes of agreement features! (HEAD, FOOT, and CdflTROL), 
Co which agreement processes apply. I:i lexical functional grammar and re- 
lated unification grammars, the sole agreement process (unification) applies 
uniformly to any subset of features, and most commonly applies to all fea- 
tures together (1 = 7). In the tfrH.^rjjTJEt'^-tiFjdinsr (Aeorrrj of Chomsky (1981: 
19E2L 1 g-S&Ji, Agreement processes apply uniformly to the unbounded Vector 
of "^Features. 11 

The set of syntactic distinction a is also Pliable — different languages em- 
ploy different distinctions, and different theories often postulate wildly dif- 
ferent feature*. I am trying to get results that are invariant across a wide 
range of li nmiislic theories, The significance, then, of the fact that the Sit of 
syntactic distinctions varies from, theory to theory is that this Set will most 
likely be explicitly T-ariahle in the true 1 Linguist]*; theory. As mentioned in 
Chapter 4 h pronouns in different languages are marked for a wide range of 
.:.:= t::ir-.ii.:-:is. ;:ic : these va:y considerably from l.u ;;,i;v^i-- i:i Ui i ; l ■lu.iit- J:i -n 
called noaconfiguritional Languages Such as Latin, nouns express mjqiy more 
overt case distinctions thin in confirm ntion a) Eangnages such, as English. 
The number Of agreement features, specified on reflexives varies from lan^ 
guage to language: the Russian object reflexive sebja is featureless, whereas 
Modern Engh'sh reflexives arc fully specified for the person, gender, and 
numher of their antecedent (Burzto 198S)- 

Finally, in syntactic theories that concern themselves with agreement pro- 
cesses- the number of distinctions induced by agreement features is certainly 
large, For example, Finnish is known to have sixteen distinct cases., while 
the Guinness rJoot of World Rcaardu states that Tabassaran has 35 different 
cases, all subject to agreement constraints, In the Aspects transformational 
grammar modeL, syntactic classes are characterized by at least ten ujeiujv 
features (nominal verba], manner, definite,, aux, tense, aspect h predicate, 
adjective, predicate- nominal); prepos] tionai phrases are characterized along 
an unbounded number of syntactically- relevant dimensions {^Direction, Du- 
ration, Place, Frequency etc" p.107); nouns are distinguished by at least 
ten syntactically-active features (common, abstract, animate, human, count, 
det L gender., number, case, declension- class); and verbs are distinguished not 
only by such features as object- deletion, transitive., and /or progressive, but 
by their ability to distinguish all Other syntactic categories in their selectiona) 
restrictions, ti&vernmcrttrbinding theories at sy\.ii.x urn similarly capable of 
enforcing agreement with respect to a large number of distinction*; for eK- 
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ample, selection aJ agreement OttUH along such dimensions as theme (agent, 
patient, goal> proposition, Zlf--} and case {nominative, accusative, objective, 
oblique, genetive s ergative, clC-J, in addition to all the distinctions of the 
Aspects model. In ^flerufisfid phrase structure gramrrj^t?- some agreement 
features, such as PFORH and SlTBCaT, are capable of miking WJ unbounded 
number of distinctions— ™<S even if all GPSG features were restricted to 
two values, GPSG agreement process** would still be sensitive to the mo:e 
'han I0 ns distinctions made by GPSG 1 * complex feature system (Ristad 
1986). Lexical-functional grammar has agieera.cn I processes sensitive to the 
literally infinite number of distinctions thai LFG's feature system is capable 
of making (because syntactic categories in LFG may themselves contain an 
arbitrary uumber of -Syntactic categories). 

In short, linguistic support for the idealization to an unbounded number 
of syntactic agreement features is quite significant, Now let us consider 
whether the same is true for phonological features. 

A .2. "2 Unbounded phonological features 

The set of phonological distinctions is uniform with respect to agreement 
(and other phonological processes) because phonological agreement pro- 
cesses such as assimilation and harmony appiy to natural cEasges, of phono- 
logical features. That is. no feature ha* its own idiosyncratic phonoEogJcil 
agreement process; rather y one or two phonological agreement processes ap- 
ply to all natural classes of features, as determined by a language- universal 
feature geometry (Sagey l Q 8fi). 

Th* fl*t of phonological distinctions is variable Wcause the set of phonetic 
segments (and articulator J 1 features) varies from language to language, as do 
all abstract phonological distinctions such as degrees of tone, vowel height, 
sonority and stress, The domain of assimilation processes also varies from 
theory to theory, language to language, and even from speaker to speaker, 
as do morpheme classes. 

Finally, the number of phonologi tally significant distinctions is large. For 
one,, the human articulatory apparatus carl produce a large Lumber of articuU- !■;■-" ■■ 
distinct and acoustically-distinct segments. The transcription key in Halle 
and Clements (lS83J t lists £2 consonants marked with 12 additional distinc- 
tions and "il vowels marked with 7 additional distinctions, for a total of 771 
(= o2d+H7) purely phonetic distinctions. Their system employs 21 dis- 
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tiiKtivi: fcu',ui'.-5, Chum.sk* and Halle (196S) use £8 distinctive features, and 
the articulator^' tree geometry of Sagey (I^SfJ) employs 21 nodes^ Phono- 
logical processes are additionally sensitive to the distinctions created by 
the sonority hierarchy; syllable structure (onset „ nucleus, coda, appendix., 
branching/ nonbreaching structure, number of feet, syllable weight, -e t c. j : 
tone (a range of discrete steps- from highest to lowest in addition to rising 
and falling tones* and ton-al dowm4c-ps)i stress (degree and type of foot); 
and so forth. Morphological processes are sensitive to all those phonological 
distinctions, plus a set of morpheme clasa distinctions, that lb itself uniform, 
variable ind Large 4 -and bULCt best seen As unbounded. For example, there 
are upwards of twenty noun classes, in the Bantu languages, and no reason 
to believe l noun class I s in » Bantu language h In any sense the same as 
L nObfl class 1' In a Romance language. 

The number of artkulalory f phonetic) distinctions, would seem to be bounded 
by human physiology. But there is significant evidence that the bound is 
not a constant, even with a fixed set Of primary articulators-. Many features 
such as vowel height t tone< and sonority may be best seen as the arbitrary 
discretization of an infinite continuum, a bind of scale, Some languages have 
six degrees of vo^-e^ heigh. . while others have only three: and certainly every 
language can have its own sonority hierarchy ami tonal inventory, Moreover, 
there is no reason to believe that that the language faculty is incapable of 
using additional articulators, were they made available. For example, speak- 
ing often is accompanied by the meaningful use of hand gestures and facial 
expressions and the movement of secondary articulators such as the jaw. 
Thus, although the number of muscles in cur foodies is a (large) constant, 
the language faculty does not appear to be tied Lo a fixed set of muscles. 
(witness sign languages) or muscular movements, and therefore the idealiza- 
tion to an unbounded number of articulatory features- may be empirL<vtlk 
correct, in addition to being theoretically justified on grounds of produc- 
tivity [being uniform, variable, and large). In fact, the language faculty 
may be maximizing the number Of perceptually observable distinctions in 
the domain of a given sensory-motor system (-Stevens and h'cyser 198£). 
Therefore, If the human motor system were capable of producing additional 
perceptually- dis tine I segments, the language faculty might employ them. 

In conclusion, there is significant support for the idealization to an un- 
bounded number of linguistic distinctions in both phonology and syntax, 
To assume otherwise is to vastly complicate linguistic theory. To argue 
otherwise is to present a finite language- universal list of afj possible linguis- 
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tlcalty significant features, a project whid) has yet to begin and unlikely to 
finish in this century. 

A-2.3 Limiting unbounded idealisations 

It does., however, seem reasonable to limit the number of distinctions hy 
sorfljft sharp order 'Of- growth in a natural parameter. The natural parame- 
ter for language learner might he the amount of time spent acquiring the 
language; in the case of a computational complexity analysis, t-Lc natural 
parameter is the size of the input lo the reduction. The polynomial time 
bound on reductions limits us to specifying a feature system wjth no more 
than a polynomial /(«) number of symbols, which can make at most fct+i 
distinctions for k- ary features, which is maximal when the features are bi- 
nary. Some stricter limits include no more than an exponential number of 
distinctions J*" 1 * (linear number k ■ n of binary features) or a polynomial 
number of distinctions- n* (logarithmic number k ■ log re of binary features), 
ft is desirable to limit the number of di-stiiKtionS available to a reduction 
because Ibis forces us to use Other unbounded linguistically-significant dis- 
tinctions, based on other linguistic structures, in order to simulate increas- 
ingly complex computations. In each proof % I explicitly State the number of 
distinctions required for that proof to succeed. 
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Appendix B 

Structure of Elliptical 
Dependencies 



The gflal of this appendix is to provide M MiaJysis of inferential dependencies 
in elliptical contexts, such as VF-ellipsis (70a) and CP-eUipais ("70b), that 
does not make use of a copy operation,. 

a_ Felix f hates his neighbors] ?.\:d sr> docs Max ]e|, 
b, Felix told Kyle [thai he hates his neighbors] and Max told Lester 
[* 

I aiRue that the facts of elliptical dependencies can be accounted for by 
two representation al innovations. First. ellipsis is analyzed as identKally- 
composed thematic- structure sbusri hetweeil the OVeri structure and the 
dories potl dine; null structure. Second. [.Ill 1 two relations of referential depen- 
dency link and obviate, are generalized to hold between positions in the 
thematic- structure as well as positions in the phrase-structure. 

Before proceeding, let us establish. sOmc terminology. We say two e^eme n:s 
.;,* and tf' in different structures correspond, v hen they ate in eqnirajfint posi- 
tions and receive equivalent interpretations. Assuming an appropriate notion 
of" structural equivalence. In example (TO). Fclizand Mar. correspond, as do 
Kyle and Lester, 

As wc .saw tn chattel * L the central theoretical problem posed by ellipsis 
it that the invisible structure must be an independent copy of the overt 
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strut lure; yet at the same time., it cannot be;. 1 

At beginning of section 4/2 t I presented evidence that the overt structure 
mast be copied to the position of null structure in the syntax that copying 
it A- recurve process., and that anaphoric elements may be Hated to their 
aDtecedent.fi either before or after the copying (the copy-and-link theory i.l), 
Xe>rt, I falsified this theory by showing that the null structure is not an 
independent copy of the overt structure, because (i) the original and its copy 
do not obey the same post-copy big linguistic constraints, and (Li) piocesses 
that apply after copying, such as linking, do not apply independently In both 
the original and its copy, To resolve this apparent paradox, that copying is. 
both necessary and impossible, I sketched an empirically superior predicate- 
sharing theory 4.2 at the end of section 4,2, 

In this. appendix, I fill in the details of such theory, and defend it. Briefly, I 
propose that the invisible VP shares the thematic-stfucttire of the overt VP, 
but not Its phrase-structure or phonology. 1 also generalize the two relations 
of referential dependency, link ajid obviate, to hold between positions in the 
thematic- Structure or phrase-structure. Let or he an anaphoric element in 
the overt VF, $ an argument of the head of that VP„ and (F the corresponding 
argument of the invisible VP. The invariant interpretation of ft arises when 
ft links to the phrase-structure position of $- The covariarlt interpretation 
arises when a links to the thematic-position assigned to £, because then <x 
also Links to the thematic- position assigned to .a* 1 . 

Now let a locally obviate the thematic- position assigned to £„ according to 

binding erudition B, Then a also locally obviates the corresponding argu- 
ment 3' because the same thematic-position is assigned to both # and Of. 
The cases of invisible obviation arise when O is (inked to some antecedent 
y and §* is coreferential with *f. Then O is both obviative and corefcrentiy". 
with ^, which is a contradiction. The «c.-tails nf this analysis may be found 
below in Section B.4,3. 

It i* of course possible to develop an alternate analyses* that does not refer 
to a level of thematic- structure, and does not generalize linking and obvia- 
tion to thematic^ positions. Such an analysis is. sketched In section B-3; it is 

1 tor hjaloncal leaacati, ellipsis phenomenon bai beer caJLetl K tM«tion.' E'3st:r.;iaJti. on* 
of i «■:,: ii ii -I <:t] ji ii jib L n«nd isiinct" JnfenmctuTei in a xLrucliiEit <fc*cri ption could lx> deLcwd 
in tkn Cl-tlructTiTC to S-ilnictore deriraCioJi (R*** ]M-fi7; K«nui J 97]}, ia the logic aJ form 
co S-itmctui* dcri-vaiian (McCwIej- MS"!), 01 in ih.E Sjti art Lire to PF JerivttiaB (S*g 
t?7ifi>. 
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considerably less elegant. )Ay central motivation in this researtL, however, 
is to accumulate evidence for the constructive complexity thesis for human 
language. In the introduction to the report I ar^ue that Jiumitft language 
Las the Structure of an NP-COmplele problem. That is. the process of ^ou- 
st rutting linguistic representations is bounded above by MV and below by 
NP-hardness, As proved in chapter 4, the copy-arid-tink analysis, of ellipsis 
leads to a complexity outside of MP (in fact, to PSFACE-tl wdlWM), Dy 
cbmmatir.g the recursive copy operation from linguistic theory, we provably 
reduce the complexity of representing ellipsis from PSPACE-bardliw to in- 
side A f ?\ The fact that Such a reduction ifl complexity is possible constitutes 
empirical evidence for the JtfP upper-bound. 

This remainder of appendix is organised as follows. In, the next section, Sec- 
tion B.I, previous work is reviewed in ao attempt to illuminate the inherent 
structure of an adequate account of elliptical dependencies. We begJB with 
the earliest theories, of VPE, confront these theories with empirical difficul- 
ties „ and in this mariner move to successively more sophisticated theories, 
Section B.2 presents, the phenomen&n of invisible obviation in detail. Sec- 
tion B.li discusses the necessary structure of an adequate theory of elbpsis. 
Section B,4 proposes an explicit system of representation as it applies to 
VPE, and section B-o illustrates Et for the tricky cases of invisible obvjtitiadi, 
invisible crossover, recursive ellipsis., and nonsubjcct covariance. 



B.l Previous work reconsidered 

It is the central insight of airly work- on VP-ellipsis that both overt and 
null VPi Correspond to identical underlying predicates: either the pronoun 
Ai'a Inside the identical predicates refers to a constant (either- £06 or Fkli* 
in example (83)), resulting In the invariant interpretation, or it refers to an 
argument of the predicate (In this caae 1 the external argument), resulting 
in the covariajit interpretation. In this chapter^ we accumulate evidence 
for a refinement of this view. a If this is ify then the central research. Ques- 
tions are how to represent the predicates, and what constitutes identity of 

2 Tbc "identity dI piedii;itM n absETTatiom k*i t>**a made La somt form or Dtlier, ap . 

PH4Bdr «ndep*nd*iiEJijf, bv l vtidi, tiap: of author* including UcCtwiev (1MT) Keuun 

18T1J, LtooJlc JISTJJ, £ij <I976J, WB]L.mk (1977), ai,<j Rnnhart (19§3>. Kftuu 1 . * ot k 

« P*rttcdtaily inhabit for the implicit* of Jto pmentatira]. and Sa^s far tli* fanarfih of 

Hi empirical JnvestLjiMion. 
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predication? 

B.l.l Covajriaace reduced to ijrtdication of subjects 

The guiding idea o: 'xH-h Sag (1976) and William* (1977) is to reduce 
anaphoric co variance to til* predication of subjects.. This idea may be 
described informally as follows. At *ome level of representation ifter S- 
structure — eithw at LF or in the discourse gr&mrnstf— a \'P is repfc-sented 
as a one- place predicate, where the- external argumenl of the VP it bound 
by a A-variafele inside the VP, as In (^i,fr ea* &«i dinner]'). EKerctamg 
some amount of charitable reconstruction, we may Say that pronouns are 
assigned free "referential" indites at D-structure. The grammar contains 
an FrOflOUil RuEe that optional!}' replaces a-n anaphoric element coindexed 
witb the subject with a variable bound by the A-operator, as in (Ai.[j: eat 
x dinner]). At some subsequent level of representation, the A-cxprcsslon 
corrcipondifiU to the overt VP is copied to the position of the null VP. The 
covariant interpretation i-v iibtained when the Pronoun Rule applies; the 
invariant interpretation when It does not. 

Although the particular mechanism of A- abstraction is not a natural com.' 
ponent of the cunent principk^aud-par^meter framework, tbis idea may be 
easily implemented in a number of otber ways using mechanisms tbat have 
been independently motivated. To illustrate the central issues. \:\: consider 
iwn mechanisms: predicate structure- and VF- internal subject. In either 
case, tbc LF representation of VP-etlipsis is Interpreted (after LF) as if the 
VP predicate appeared in the position of both overt and null VPs. 

First, we may appeal to a suitably modified version of Williams* (198Q) 
predicate tfructtire, where the subject- predicate relation is represent*! by 
roindexing each predicate and its SUbJ*Ct r The covariant interpretation, 
where the anaphoric element a refers to the argument, of the predk&tO.. is 
represented by assieTjr.g the same variable index ta the predicate and its 
embedded referentlally-dependent element a, as in JoAni /o(e hia tfmwrji- 
The invariant interpretation t where Of refers to the matrix subject „ is repre- 
sented by assigning the same constant index, to ft and the matrix subject, as 
in J&hni fate kin dinner j^. (Here we temporarily depart from Our convention 
of using subscripts to represent apeaker- hearer judgements.) 

Second^ highly articulated p3ira.se structure can give rise to a linking ambi- 
guity, For example, we might postulate a VP-internal subject position, fol- 
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Earing Fukui (19S6J, KJUg;wa{Eg8 Q ) ? Koopman and Sportiche (1&B5;1DS6) ; 
and Kuioda (1&§S). Now every embedded prOnOun COfeferentiFL with the 
clausal subject may be ambiguously Linked directly Id the subject, of to the 
empty position in the VP that ts, it-ycLf linked to the subject- In the JaaeT 
case* we. may crbtiun ihe t-ovajiant interpretation; in the former case h we 
obtain the invariant interpretation, when the subject js a, logical constant,, 
such, as a proper noun or definite NT. A typical surface form is; 

C 71 ) MnfF^M] (vp[r»pe]l (vj hates [ N phi* neighbor*]]]?] 
and [bq doe* [Max [vFe]aJj 

When the subject of first tonjunet is x [cgica] constant such as the proper 
noun Felix, then the embedded prononn his can be Linked either directly to 
that logical constant to obtain the invariant reading, or to the VP-idternal 
specifier position [jjpejl (which is itself a logical variable linked to the sub- 
ject) to obtain the covuknt reading, 

B.1.2 The problem of nonsubjtct co Variance 

The central prediction of any such theory is that the eovariant interpretation 
is Only available for anaphoric elements coreferential with the subject of a 
predicate that contains them. This predictinn appears to be false, As Rein- 
hai-t (1 933-' 152) observes, covariant readings *re available when the relevant 
ellipsis is not VP and when the antecedent not a subject; 

(72) 

'a. We paid [the oro-fes-jor^ hisi expenses, but not [the Student)]. 

(|tpc didn't pau jthe studentfo ni£?i/2 expenses]) 
b. Th* nurse referred Sieefried i to bisi doctor, and Felixj too, 

(\ih£ nurse re/errcd feftx-j to his^^ doctor]} 
<. You can. keep Rosai in her] room for the whole afternoon -, and 

Zelda-j too. 

([jlflu Can keep Zclda-i in her^f? room ,. L ,|) 

The simplest solution to this difficulty is to assign a new phrase structure 
to these constructions, where- what were objects become subjects. Then 
the Sag-Witliams analysis, which reduces covartante &0 the predication of 
subjects, would Still apply, mutatis mutandis. One such approach, due to 
Kayne ( 1981; 1984), analyzes the doable objects of the verbs in {72) as small 
da-uses, as in (73)- 
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(T3) We believe [| sc John V [a genius]] and [sc Bill [«]]] too. 
([a genius]) 

K a-yne suggests that small claum of the form [gc NP NF] contain an embed- 
ded abstract verb-like element V that expresses the thematic relationship 
hrtween *.he tv-o objcCta. (In the case of (73a), Kayne would postulate Ml 
underlying abstract <be' element, ie. f [belles [NP lis NF]]]; in (74a), Kayne 
would postulate an abstract 'Liive' element, ie., [pay [NP [has NF}]}-) Then 
Keinhart's examples f72) would be asaigoed the phrase structures shown in 
(74): 

^ -a. We paid [[ sc the pro&*sori [V his; expenses]]] but not [sc the 
student [c'i '.' 

b. The nurse referred [[ sc Siegfried,- [V to his; doctorji] and ( sc 
Felfoc le]i] too]. 

c. You can keep [[sc &asaj \Y ^ her J TOCIIfl ,c "" the wioLe 
afternoon] ij and [sc Zelda |e]i] too[. 

A second approach, due to Larson (1958), would assign the highly articulated 
phiase structures in (75) to Reinharl 1 * examples from. {12)', 

' 7& 'a. We paidj [(yp [the professor] j (vl [U tj] [Ul expenses]]] but not 
[ v p [the student]* [e]J|. 

b, The nurse referred^ [[vp Siegfried ((,- [to his doctor]]] and [vp 
Felix |f[j tod], 

c. You can keepf [[vp Rosa |(, fyp [In her room) \u [for the whole 
afternoon [J])] and [vp Mda [e]\ too}]. 

Thews novd phrase atructures also hold the promise of assisting Our analysis 
of covadajil interpretations in CP-ellipsls, as in (76). (Keenan (1971) ana- 
lyze* these constructions;, which lie calls £~ -deletion, and demonstrates that 
the cova-riant coreferenre relations in the elliptical clause may be arbitrarily 
complex,} 

(7o) John! told Bctty 2 (that he A thought shej was drunk] and 

Orvillej told Naomi* [*] (too) 
[[that fits- thought .ihe 7 f 4 was dnsin^]) 
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As before, both the agent ( subject) arid benefactor [object) of tell would be 
underlying]? *ubje£ts of predicates, and hence both would be available aa 
the antecedent of a comiiant interpretation. 

Observe thai CP-eUipw* (77a) and PP. ellipsis {771;.] must be distinguished 
from the cm-rasp-oddlng NP-elUpBJS, as in (78). 

^ 77 V Sally Told John, [cp tjs-a* cookies had been baked] and Deb told 
Andy (c) too, 
b. Sally told John [pp about the fresh- baked cookies] and Deb told 

Andy [e] too. 

("S) t *, gail>r told j o]in [pj, a|l interesting storyj and Deb told Andy 

[e] too, 
b, * Sadly caw John fcjp fresh -baked cookies] and Deb gave Andy 

[t] too. 

This distinction appears to be related to underlying differences in thematic* 
structure, lii particular, the tail of (77) is like inform in that it permits arl 
optional theme argument, as in S*% informed John, whereas the yi'tMf and 
tell of (78) are like rrifft? sn thai both require an obligatory theme argument, 
as in *" Sally fttated/gave John. Thu&j it scciBS that elb'psed arguments do 
not satisfv obligatory selettional constraints.. 

These fact* present a serious difficulty for all approach that attempts to 

reduce either nonsubject covariance or CP-eUipsiB to Yl-ellipsis under the 
Kayne/Larson analysis of double object constructions. In such an approach, 
the benefactive antecedent 8 is in the specifier-of-VF position t and the el- 
lipsed structure is a VI- So a rule of Vl-eUijwU is needed. However, the 
unacceptable example (£0a) would then be assigned the permissible struc- 
ture in (SOb OF e), showing that not all VI eonttituents may be the target 
of ellipsis. ~ 

J A. further wchnJcaliUHiiiiUj, parlicnUr to Liteon'R ana]j.»ii d{ double obj*CL<:niiRtriic 
lign, aocujH In CiM* of Heavy NP Shift, which. Urnon Mialyiffl a* Vl—VO ieanal?fiifl 
foL-^-ml b\ I.nht Pf«iica1c Kaji-in* ;* t&ecE caMH. Ill* TOnrtrinMl aTialwdi LacocrecUj/ 1 
r«dj;"- i": •' i' '-■■ rovinaiiL :nre:i>reULirvn is nar available wTt«i tlift Indirect abject b the 
BlJWWllint ("^ijr amply twc&TIM Ibe indirect objttt h** btea ancaiporttcd LblLo the VB 
WITtpl** and « &» loJi^Pl * subject, as a ho* 11 in (T9h).: 
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a> * Sally give John fresh- baked Cooties and Deb gave- Andy [c] 

b, [$a]]y gave [John [y t V fresh- baked cookies]]'! and [Deb gate 
[Andy [ Vi e]]] too. 

c. [Sally gave,- [[yp Jotlj [ V1 [i f t t } [fresh- baked M0Ues}|)}| and 
[Deb gavejt [[ vp Andy/ [ Vt e]l]] too. 

For thj.s reason. noosubjOft <Lyiarian.ee and CP-ftUipsEs remain Open problems 
j[i Ihis approach. 



B+li3 Co variance reduced to. bound anaphora 

Reinharl's solution to the difficulties posed by non-subject covariance and 
CP-eJIipsjs is to reduce the covariant interpretation of anaphora to the 
bound-variable interpretation of anaphora- This Eolation, following an ear- 
lier surest b:i due to Lasnik f 1376:20 ) t i-s based on the observation that the 
covariant interpretation, of an anaphoric element or Coreferential with an ar- 
f ument 3 U available if and only if a- can be interpreted as a bound variable 
in the freeze of a QNP in the position of 3: 

(Sl\ 

a. We paid [every fnanji his,- expenses, 

b. The nurse referred [every victim]; to his; doctor. 

c. You can keep [some woman]; in her^ room for the whole after- 
noon. 

Rcinhart crucially distinguishes bound anaphora from pragmatic or actid«l- 
UJ conference. Accidental coreference is an extra-syntactic relation between 
Xva.1 KPb. either of which may or m*y not be referejittaJly dependent- Bound 
anaphora is a syntactic relation between an ts"P and an anaphoric dement 
a that is understood as a variable bound by 0, II is represented by coindex- 
ing a and 3, subject to the following conditions' (j) p c-commands a: and 

(Til 

*• ^ c P«^ to [tbe piDf«BMJ| the moil outlandish otpettMH tJiil hr.\ had ever 
incurred. 4ud to [JiiiL student}) wo-. 
([me pndd i$ fhiaj wludenlfc the meit uultandtMh txp«ntei that hti h#<i «wr 

b. Vfc [vt-vs p»kd to ihe piD-T«KO[)i jvp ftJn; natut aaUiadiill «xpcii*njk thki 
Ji* had c«r ii-cimed] li] 

Moreover, ihn pronoun is no lon^t c-commands b? in mtectdrni. which will also Lunar- 
recti)' black lfce dtnlred oavarianl iniujprttaliaai for these- StiBCtllm. 

M3 



(li) if a is a pronou^ then $ cannot be domi Hated by the minimal governing, 
category mgc(a} dominating Qi (lil) otherwise a Is a reciprocal or reflexive, 
and then .fl BUKt be dominated b} 1 mgc(a), The semantic interpretation of 
a CF containing $ Is pvai by the rule (82), width. A- abstracts from CP 
and replace? all Q coindfcKed with {and hence c-conunanded by) p by the 
A- variable thfct replaced 0. 

(82) [ cp ft] => [ CP (^,[^/*1)] 

Example {6-1*} is assigned the surface structure (53a) by tbe lyiiulexin^ rule 
and the semantic interpretation {8310 by tbe rule (52):. 

t V We [vp paid (every rnan]j (hisj expensefijj- 
b. {[Every man] (Ai.[we paid * [l*i expenses)]')). 

It MftlBfl that this system is meant to apply in VPE as followa, The CP that 
contains the overt VP is interpreted by A- abstracting some of its arppiments 
to form a A-expreseion E\ the CP that contains the null YP is interpreted 
by A-abstracting its overt arguments., and then applying them to E. The CO- 
variant interpretation, would arise when a A-abstractcd argument 6 has- been 
coindexed with anaphoric dements in tbe syntax, as in {S4a); the invariant 
interpretation w]ir*n 3 is "accidentally 71 preferential with an anaphoric efce- 
nient, as in (S4b)^ 

' 'a. ([The professor} (Ar.[w* paid * [* h s expenses]])) 

but not ([The Student] (Az.jwe paid J? [x*s expenses]])) 
b\ ([The professor]i (Az\[we paid X [hiSi expenses]])) 

but not ([The Student] (At. [we paid ar [tlLBi expenses]])) 

This proposal is missing many crucial detaib; Reinhart drreis not supply 
them. Perhaps they cin be supplied. There is aJso the question of the 
adeipiacj nf the proposed theory of anaphora.* Nonetheless, let us assume 
that it is correct in order to evaluate this approach to covarianee. 5 



'For one, I am no* awvinoad lh.n.1 4-h.e claimed dujcdnl-refecene* rt»B*qil*iirai foUuw 
from the ptop-OSfd prismatic Grimm llittny h*s«i en speaker/h^atE* Lalejilicms. Lii-iiil 
{11)S9) ddiciiiEei tlieae issues and. ■uth.et ■empirical failings- — d* not (yv-crlfirjk Kis lh ] • 

! E-v«i aaautnittg, thai ihfl proposed CEchniLa] j&¥fll*cn (bouDd anaphora on] 7 if o- 
command. lioLdt) tt>»*TB til* c no era] cjjea. ReiuhMt {chapter a J aad athera hive aliaeiTed. 



134 



It is not clear what conditions permit an argument ill the eLliptical struc- 
ture to be applied to the A-abstratted predicate constructed from tie overt 
clause. For example, Relnhau's system fails to expfaifl the existence of an 
independent tense marker in the elliptical cla-use. That is, why shfliild the 
subject of the elliptical Vp require an inflected agentjve: de, and why can 
this inflection differ from the corresponding inflection in the overt VP? 

(871 

a. Felix hated his neighbors, out Mzx (still) does. 

b r Felix hates hia neigh^crK. and Max did too- 

Example {SS) demonstrates that this is not a question of the ease filter 
applied to the subject of the elliptical clause; 

f3$) Felin may hate his nGiehbors,, but not Maxj. 
(ie, , A/ftSPa iUxsti 'I f\ atf: At$j y a neighbors) 

Retail also the case* of nonsnbject covariaflc* in (F2), where the overt an- 
tecedent of the to variant pronoun is entirely by itself in the elliptical clause. 

tjiai bound -inapbDr* tra ivaijahik twi worn c-canirffljmd dot* na l obtain. In tddLCiftli. 
Reiabaji's cQTreliiioil (co-v-irianf int*Tpr*t*llorJ if and oiUy Lf bormd inipbort Ln.tEipret.i- 
tfM>b** cicrpiiQBs, For MimpJe, jfednliaft prtdkm Hiai (S£b) Km a (OMiriiaL iatcrprc- 
l*iidb. precisely beciasr- <8/i*) liit a bound \rarLaMfi [nttr pre lotion: 

L £*l<i* thought abouc |fw»_v manli on his, ireddjng dij 1 . 

>■ Zt'lds lb.Due,Jit about ]evor.y man], an liLt, wadding day and aWm FfliXi 

(00. 

(fj-ii.jHijiSl 1 aioul fiJtx; dfi f\i&t urdJmp day]| 

Howevei when a p-TOPM auuji repJacti live QJ<P antecedent in tbi* example, tbe co^hb-TiI 
irUttpretaLLaii u criua*f]y n$t a^ailablE for ewh« BPeikMa: 

($$■$ m Ztldb thought ahaut Siegfcioi] u-ji hLi| lidding day ami about Feti^a I** 

fin Cat 1 !, rny informants daijrj LJr*t (SI) *:an only jtlran Lbat -^Id* liiungb.t about Felix 
trw r > Tills cmnlraBt pTesanK diffieullJEa far KetafcaTl^ correlation, at we|] aa for other 
taEDTiea. TIit natural wLutioa is to a^iu^J ikr distinction n^nw^mniaaLLficr* ind propel 
JiCnIai, ie., th* Ps-TCfler are ajaL.Eji«d iroijn; *hil« the laltEi arc not. There are a niipnfc*r of 
wj^h LO implement this propCaaJ— far Kxareipfr jx-rli-ipu .anaphoric dcTSifcridrnries (tlieta- 
Lilka. id Lbbcaief must t>« MUblnhed aud^r S-CtVinnUfld beHreem th.p ««p«l mariar r..f tl.r 
qii*niLR.i-t hii:l lh-nnE.:l,-i- ■;,:■, i-«rjible. J return If. ili^i -I I'Tl J:t:cr r^hiv* in r *cL:.:ii ii -1 1 
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A central property of Rdrm ait's system., 4JLud of the other systems w have 
CorjBgdered, ; E a fundamental asymmetry between overt and null s tinctures. 
Relations of anaphoric antecedence are established the overt til Utfure, sub- 
ject to syntactic constraints obtaining in tb.lt structnre, and then applied to 
(ho argument (5} of the null structure, So, if ail anaphoric element a links to 
an argument fl in the overt structure, then (he copy of cr in the null structure 
will also be allowed to link to the argument corresponding to .£. 



B.2 Invisible obviation 

Now consider the discourse (89), and its variant (37), repealed here as 

I" SO^ Ann: Romeoi wants Rosalind to [love him]]. 

Ben: Not any more — now Romeoi wants Juliet 3 to [cj. 
([hue Ali«t.l]J 

(90) Ann: BjomeO[ wants Rosaline-j to [Jove htm;], (f = I) 
Ben: Wot any more — now Rosaltnej wants- RomCO] to [$}- 
{[hvc him;], i 4 1) 

\n both examples, Ann's use of the pronoun him is most naturally under- 
stood as referring to Rifmeo. Yet when Ben replies in example (&D}> the 
^referential interpretation [i = 1) is no longer possible in Ann/s statement. 
This u iftv]siE>Le : ' relation of local obviatiou fan also be created entirely within 
a- sentence, vrith the pronoun understood as first including hut later obviat- 
ing Ihe argument ftomeo; 

(91) Romeoi wanted Rosalines to [love htnii] before wanting himself 
to [ij. 

Similarly, an R- expression is "invisibly oryvjalive" from its. local D-commanders, 
as in (&2). where pragmatic considerations strongly favor a coreferenti&i in- 
terpretation that can only be excluded by syntactic principles. 

(92) Sue likes Narcissus t and he,, does [i] too. 
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There are a number of subtleties however, the most interesting of which 
is that invhible ohviatfon is entirely a loci! phenomena, as illustrated in 
(§3). 

(£31 

'■ ' J a. Ue,i knew Juliet loved Romeo l- 

t>. TL'j nurse [knew .hiliK loved Romeo L i before hei djd [e], 

Although the pmnouq fit must be obviative from the R- expression Romeo 
that it overtly e-COttltn&ilds in (93a),, ii need not be obviativc from the ft- 
expression that it invisibly c-commands In (&3b), 

In face, the domain of invisible obviation is exactly the total domain of 
binding condition B. Let position i c-command position j jn a phrase marker. 
Then invisihl? obviation holds- between positions i and j if a pronoun in 
position j would be obviative front an argument in position i (unless,, of 
course^ there is SO anaphor is position j). 

This Invisible Obviation Condition (IOC), a descriptive generalisation that 
follows from deeper principles discussed below, is illustrated by the follow, 
ing examples for both pronouns (96b n 97b) and R-expressions (96c,97c] c- 
■commanded In position j: e,r 

ft tf>p<a.ni that bonk smut fl.tul m.riBi'bJc condLtw-n C eff«(S between two lt-«pE«&ions 
eta tnj flv^Knnne wiib, bwy ph.OMSJ&BH:a] stress, u in [5A) t 

(U 1 a. BILL, want*! BILL: to J™ Uny, 

b. Sim (frjnUd BILLl Ld kuu M?.Ty) BJid. BILL, did [*] laa. 

wliereas invtsiMc conflljtkih C effect* bEtwncn an R-e.Kj.-1-resjion and i c-eomrnapdjag pro- 
H9Tln *tf invL&lable. re^ard}^* i>[ the amount ot itraa (Ui), 

***}«. * He/ HE, wiTitad Bill/EILL: lo lis Mary. 

b. ♦ Sue [minted BJU/BILL] u» Jdu Hwyj ud he/HE, did [e] too, 



Tbe *Ka.TBfl«s in (fl6b) and (JTb} an wn&utacLed aiuiE a. iirti^ii T antecedent S'it to 
mart elaartr teveaJ the ia^Eibte almalian configuration;. H-*jWrvex. the IOC appEara to 
enrerUp in ttl«* examples with «i independent (not uodftTKtocidl etfttatiajnt thin e-tdudes 
sumecroK-rojijuact ajH*cedec,c« h &5Sh ftM njanr.ed'AiirJUl f.p tum «lrf ram, uanfed rinfcjeJ/ 
^ U'Fri Cfgo/. 
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' K, BtU L wanted him.! to kLss Mary. 

b. Sue (wanted him.i to kiss Mary] and Billi did [e| too. 

c. Sue [wanted BLU] to kiss Mary] and he.i did [e| too, 

^ 7 '». Billi wants PRO] to love him.i. 

b, Sue wants M.4iy to [love him ¥ ij and Billi wants FRO] to (e) 

(too). 
<, Sue want* himi to [love Mary] and BilJi wants PRO! to [t] (too). 

Examples (9&) demonstrate lhat the nonlocal obvl&tjon defined by binding, 
condition C is not relevant to the IQC- 

' a. BiLli wanted Mary to kiss himi- 

h. He.] wanted Mary to "kiss Bill], 

t, Sue (wanted Mary to kiss IdcuJ and Billi did Je] too. 

d. Sue swanted Mary to kiss .Hill]] and be] did [f] too. 

The fact that the IOC should be defined relative to condition B and not 
it terms of (the negation of) wndiMon A is illustrated with a prepositional 
adjunct in (99), and with a possessive MP in (100), 

' V Billi saw a*n*ke near bim]/hiniself|, 
b. He.] saw a snake near Bill], 
C Tom [saw a snake near Billi] before he] did [&], 

' i. Bill, knew that pictures of himi /himself] would be on sale- 
b. He.i knew that pictures of BilL would h* on saJe. 
d. Sue [knew that pictures of Billi would be on sale] before he] did 

W- 

As noted in the introduction, ike invisible structure is not an invisible pro- 
noun^ simply because there is no invisible obvjatlon when an overt pronoun 
is used (39b, 102b) instead of ellipsis ( 39&>, lOSal •* 



4 Th« eflertj af invisible obvialiyji 4f<- mciKL prananueed wh,en the lavlflLble preaftun 
ofervit,t£*. in anaphoric eLemeiiJl lliit CTUHl have a lao&l milecttlplit, sauli oh dji *r.-*|il:.i 
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1 Juliet! nought that the Filafa [poisoned bar* J without realizing 

she*] did [•*;;. 
h. Juliftt] thought the Friar 2 [poisoned herijs without realizing that 

shei did jt 3 . 

If the mjiiJ structure were simply Mi empty pronoun at LF f then there Would 
b* ao way to explain the lack of jjiivj^ifcte otmatlon in {39fc 1 102b). 

The following examples are particularly intercstinE because they demon- 
strate that loral ohviation in the overt Structure is preserved m th* null 
structure, even when it is, embedded one Level, as in (103), Or more than Oflt 
tevd, as in (104). 

f ins i 

"r!. Hill, \:::c.\:a '-'110, l., Icr.-i.- I.jtn.,;. 

h. Sue,- [wants FRO,; to love Billi] and he,| does Je] too. 

Cn Sue^ [wants PRO; to love him.,] amd Billj does [c] too. 

- a. Hilli [expects PRO, Va w» D t PRO4 to Jove hJm„;]. 

b„ Sne 1 - [expects PROi to want PEO, to love Bill,] and h^ does 

[e] to*, 
c. Sue, [eitpects PRO, to want PRO; to love hint-]] and BiTJ, does 
[*] too. 

Contrast these examples to the- samples ( 1 Qd), which show that the nonlocal 

Ohviattorj of condition C is not similarly preserved unde.r embedding. 

Tbe Dply oottfteiiraiioiis witfc, I; Jim property require m dlijrticil IhinJUva] VP, ^k-ere rhe 
subject of the bjU mrinila'Yii VT ia &11 aaapbor, 31 in fLtiU), Jn M di & ggnfigBUliaii, 
. :u»™ r :i >. 11..1 pmsibJe to -Hi rrrtly pron.L\jDLnaiiie the ovfrc. VP (Hlb'J, pwbips lor 
rtifctaiH having to 4<? with, Ibe cue filter. Ins4*fcd, ™r mmt iutcodiKM Ike aecQtiw J,j &» 
in (Idle). 

k. Romeo, utsd ike apotkM-ir^-i fc> [kjJL him 4 ,^.j] tefon: teDifc| himself 1 to 
W- 

b. + ftamw- islurd. tie apDtfcefir^ to [ki]t him] before IfiJiinj himself to it. 

c. rtnniftGj allied ike ipMbscMy s 1* [kill JuniL/jh beCaie let] in ft himself, H> do 

Tfcefe CMmpLej Um UMlbta «n Ln whether we ui *>wj? Latently view both rfr- njid. I* u 
reaJizalioiMi of ID, 
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^ i0 *al Bill, [wants PRO, to know if Maty loves IliitiJ. 

b, He, [wants PRO; to knew if Mary Loves Billi], (i 5* 1) 

c Saer [«wti PRO; to know if Mary loves BiUi] and he] does [t\ 

loo, 
d. Su«i [wants PR.O, to know if Mary loves lurch] and Bill! does 

[e] lev- 

These facts are exactly III, accordance tflth the IOC 9 

These apparently novel examples provide powerful evidence for the structure 
OE" elliptical dependencies. Kot one. they argue against any non-Syntactic ac- 
count: neither the discourse gtuanur of Williams (.1977) H<" the semantic 
interpretation of R«inhart (19S3) are able to maintain the- purely syntactic 
(te-, sentence-Level) distinction between local arid nonlocal obviation nec- 
essary fur the IOC Second* they argute against the standard asymmetric 
account, where the dereference relations in the oveit structure are simply 
imposed on the null structure in a- maimer lhat satisfies identity of predica- 
tion. 11 Third, they also constitute new empirical evidence for the exiitAnte 
of an explicit relation of obviaticrt that, Ula relatJon(s) of antecedence, is 
computed in the syntax at S-structure and subject to semantic interpreta- 
tion (Lasnik J97r>;iaSlj Chomsky 1930; Finer 19S4; Higginbotham 19S&}- 1D 

1 Chomsky U9&1) and. olh« *mn«TH hive accounted lor sT»Ii( crMWVftr p hen (until an 
is a condjtiaii € eSTecl TV fift that condition C eflecta do not arise in tlfipticaJ structure* 
jivci ua a direct ejapiticsJ lest for this liypc-Lcieaia Tli<- tlfi' nf inYJfihLn stiDn.£ crccsavec 
:u (10&) JrteiD (li-lt slTflr-R craswTer cannal be due to {Diujitjan f'. 

I 3 L. The man who, M*m uid that he.. ILkes J,. 
fc. Tbe man i*)io, he-.; a-iid ttiAt Nfaryi likei ( H . 
r . Tbe mail who, M^t^s [a-iid tliftl «}lCt lj)w» Ii| and wLd, be, did [<r] 144. 



: °Fin.M f l 0*J ;■ eihibLti a ctaau ot ku.m*n Ifcnmifcje* with a "switch, reference" aj-srtm, 
where the relations Dfcai-efcrtn.es ftJi-d oration between subjects are orcrUj e*preiwed in 
the phonetic taicn at an. ut-tcraillW, by distinct maipbcmcj. 
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We discuss t|-.<: details of o-.u ^presentation below, 11 ' 12 



B.3 Necessary structure of an explicit theory 

Id order to represent the elliptical strmctams in the T-model with the stan- 
dard bidding theory and using toindexing, we would need to postulate an 
S- structure to LF mapping with following StK properties. 

1. The mapping moat include a copy operation capable of copying the 
entire overt structure to the position of the nulS structure, even when 
the uuJl structure is in a different sentence in the discourse, a not- 
insignificant revision of the T-model, which Ja {was?) a theory of 
sentence gianuiifcr. 

1. Thtfl copy operation must he able to replace an anaphoric element a 
with a variable that sometimes inherits the agreement features of & t 
us evinced by examples ($1) above. 

3. In order to account for the invariant interpret a.ticiri of an anaphoric 
element or, the copy operation must be able to sometimes copy the 
referential index of ct, 

4. In order to account for the oovarjant interpretation of a without over- 
generating as in [Q&> 64), the copy operation roust be able to ass^n 
the copied of the referential index of the argument that corresponds to 
jS when it doea not copy the referential index of ii, 

5. In ordar to account for the lack ofinviEible condition A or noillocaJ 
condition C eifects, we must confine binding conditions A and C to 



Tht irjHEiEntaLJijii toi anaphaiii »e propose is similar to thai of Ctunntlty (USD 1 ), witb 
the crmciaJ difference (Ii^r oci Dbvtaiion in a [elation bstwr^n peaitinns; phriH-atxacture 
Dbriatinp m* r be nonlocil dad in aJwiy* o**rU *Jiil* t}iem*li<:-ob«aLHMi ■ Jmij &Jli l mar 
be mwaLble. Ciiatnaky'i K j«taph&cic Liwlice*" a[ ? [datimiB- ainDBRj Ar^'UJiiKBto aiuj bene* 
<*ould aDt ™>Tk fcu the prwcdjn^ examples af invksaHi; obviatkHi. 

An explicit relation of obvialiOB in independently jnoLtTated on conceptual grounds. 
RepTeaeatttioaa h*¥e a des™ nrf perBfi-inence beyond cOTlditLa»i ai those jeprejeniatiriTi*; 
CDttdJUQUS nbould not ipply foejoad. tin- "creadan'' of ln«e representation*, GUriatum 
between twa positions is ■ cunciLtiMi that must fee satisfied in the semantic inHsrpietalwm 
*f a ha S uislk rej,ieienULi,->it :a die- context af th* diaccinue. jmJ thwtfote si * relation. oS. 
Hi dw Q , nai m^iy a precondition an tbr canslnicCiflJl a a-yatMiiic ifllMioh ot oaiefertltte 
Or anteeeden-nn. 
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S-stmcture. 

fi. In order to amount for the IOC, condition B must be enforced at 
IS, and H-exprcSS-ions must be replaced wjth pronouns at S-structurc, 
but only when the LP copy of Ml R -expression is C- coram anded by a, 
coreferenUaE argument in its minimal governing category. 

Let US therefore consider an alternate approach.. 

We: have seen that the overt and null structure* are symmetric with respect 
to certain relations of referential dependency {antecedence, local obviatioTi) 
while being asymmetric with respect lo renditions, on those relations (agree- 
ment, binding condition A)- That is, the conditions are strictly enforced in 
the overt Structure, bat blithely ignored in the nuil structure, This Strongly 
suggests that there is. really only one underlying representation that the 
overt and null structures correspond to the same underlying thematic func- 
tion, 

A more degfcnt representation for ellipsis, then, is to segregate phrase Struc- 
ture from, thematic structure 8Jld posit a relation of Local ohvi a.:Lon t!n at 
holds between thematic-positions. Then we would simply say that the overt 
and noil structures share the same thematic structure and hence they share 
the same relit ions of iinking and lotiU <ihvia.tion. Invariant and covariant 
interpretations are accounted fox by linking at the levels of phrase- and 
thema-tic-structure, respectively. The IOC is accounted for by defining con- 
dition B In term* of nonanaphors, as the obviatson of thematic-positions. 

Let U9 now maie our representations explicit, 



B.4 The proposed system of representation 

B.4,1 Segregate piirase and thematic structure 

We propose to segregate phrase structure from thematic structure as follows* 
Phrase structure consists of a set of labeled points (syntactic constituents) 
and the famiLiar relations of immediate domination, precedence, and so forth. 

Thema-tic structure consists of argument*, functions from thematicaJly-typftd 
argument positions to function and to arguments, and the relations de- 
fined on those objects,, including relations of thematic discharge belwwn 



142 



argument petitions and arguments (theta-marking), as well a* relations en- 
tirely between, argument positions (the Ui- binding and! sheta- i d erttiftcalion ) . ' ' A 
Arguments are identified by integral indices;, functions ire identified by 
integral subscripts, on the generalized function symbol /. For eiajnpJe, 
Viofl : rol*ij2 : rolaSJ 1 ' Identifies the particular function /m(-), a func- 
tion Of two them at icaHy- typed arguments. For clarity, only the theta- 
position that is currently being discharged is depicted, as id u /\n(2 : rolaS)" 
when the theta-positlon ? of theta-type rolo2 is lining discharged. By con- 
vention, the (curried) arguments of a given function are assigned successive 
indices starting with 1, 

Motivated by M&fiiLlz (1990), I propose thematic- fune-tJOiLS of order D. That 
is, a VfJ function /f() jtl combination with its most affected internal argu- 
ments (such as inalienable possessor,, theme/patient, ins trument , or affected 
object Locative) returns a new verb-stem thematic function /,^(-J (Maranta's 
"ewmt 1"), The verb-stem function f*(.) combines with the next most 
affected interna! arguments (such as benefactive, directional locative, or 
alienable possessor J to return a new VP thematic function f?[l \ tenaa,2}, 
which is a function from an [0 tense and an external argument (typically 
an actor} to an entirely saturated function (an argument of thematic- type 
'proposition')." This wiJl play a role in my account of why a vorb plus the 
benefactor is never the target of ellipsis., see section B.5.1. 

The relation hetween phrase and thematic structures is represented as the 
pairwise connection between elements in the striKtnrtifr. Fbr example, (107! 
is assigned the structure described in (10S-llfJ) 3 where we have suppressed 

A* mealioned La einpter i, a tiitmitir |XmiU4«i must Lnbcrit the- agjeemcBt battle? 
Qi the- argiitVK-fn that saturates it. (at jam*. uftumenH, Tt* set of prariOUua to Tvfaicrt th* 
i rousis applies Katies team spefcfcn to apeaJcer. 

"The BDtitJon !us«l fa ihemalM Structure (k., FuKCiOn* of variant otdera) does not 
lUittt forniiJJr L>nrj,(M* oil chaiaa ire fctirtally equivalent, AnFth,Ln£ done ijy one c*n 
be dor** t? ike other «ith *nb[ Ea Lt r (o^rUys). Muutx (1 999) dJetin 8 nuh™ two repi*. 
jeniilioiB Of theniitic fuBClkiJifl. In one, tJte verb it a Voider fnn<;(Jott a{ ail aTgnmeiilB 
tonlaLned. in the proposition (intern*! trsomeats,. *Vent, *nd externa] jtrgiLrnejitl. This 
approach TTi4ke4 lose of H lKflFn*tic-^ld» H (ct, Sl<™*][ Kftl; LcrLn *nd Rippapait ISA&; 
HLgffijbolhw-rt lS85;J9a9). MwaJlU contrails th,H with the une dF fci^lict oidex fundiOBS, 
wWefe have tie. udmtiEage dF QatUTijr> representing th* foet, Litsl Lev* iiFw(«t argument: 
We feaigaed a wmposilianal thr ta-rc,L E , renjJtdng; from a *erb in CDmbtfiirJoii ^itb its 
more affected intrmij iri^ir.eii<s !r:f., Ch^inekj ]*B]; Marint* J.UH), Td mow B4tiir*lJf 
Eapture ™mposdtiDiiaJ tbftm 4 (k-mk auLgairtEBt, ] uee Jit^ier aidei funclLana. An<JtK«r 
reaorm foi utin^ bLglie-T-ord^r tWtnilic-functLmi* l* to define a c-TDmmittrl fetation ftii 
tbtinadopojLtiona, wliici will gceiti)' Kimplifj- th*- st^tsmen* af tbr biodinf loeorv. 
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many important details not lajevant itl this context, 
(107) Fells hates his- neighbors. 

The possessive morpheme \ r s] is a function of Uki iiTgnnmnts, the posses- 
sor and the possession (ie., the p<JE-$csse<t LjtLngJ. First the pronoun he. i& 
t beta.- marked with thfttheta'p-ositian /»(1J. Then /a]{?) theta-binds fna{l}, 
resulting in argument 4 (the dosed tsT fies nei^hotifs). 

{106) [Npfcrpfonlw, 3] M^]. /»( 1 : owner')], / M (2 ; pesfluaion)] 
[Kanaghhors, /^(l - obj*ct)], I] 

Nest, the VO function /^(l ; gbj*Ct) of the verb Aafc thcta-mfcrks argument 
4, and returns the VP function /fo( ' ) : 

(109} [ V p( vc ,hate,. /? (i : chjictj] [his neighbors. 4], 
fi? a {l : event, 2 '■ actor)] 

The phrase- thematic structure detailed in (108) 1^ italicized and summi- 
med in (1(19). Finally, /f (l) theta-marks argument 2 (p*3t tense 10), tad 
Jtafi) theta- marks argument 1 (the Subject Felix), resulting in argument 5 
(a proposition): 

(110) [ w [yp Felix, 1] 

|ii[]fl[-P*5tL 2] [vpFjote fow nfl^Afiord, /f (l : e™*)], 
/? a (2 ■ actor)], 5] 

B.4,2 Two relation a of referential dependency 

We further propose two relation* of referential dependency. Lint and obviate, 
denned on constituents (phrase stmclu re points) Mid on theta-pos-itiona (the 
argument positions of thematic functions). The linking of theta- positions 
is favored; over the Doindexine; of Iheta- positions by the same reasons that 
favor linking over eoindexjng in the phrase -structure 3 * It \s needed to 

,6 TIj«* u* truuHient* bolt ways: what*™ argumente cm be mid* for linlrina, can 
aJwi he rnidf Est Ihcla-lmkinj. Lasnhlt ri9£B) arjueft fat fc relation uf CDiirdejring <m ihe 
basLj ai ttadLtMHi C cflJecm. Binding condition C Lt H>raewb.aL myalenoiij in *, lbilrin& 
thetftfr btCluSe Et-eipiesHOns Il*dt Rf^r ha™ antecedents, Jfri JB««t h*t* links to indues 
condition C effecto, 
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reveal moie information ahoitt sp]l t antecedents and the interpretation of 
direct/indirect antecedence. For expository conveniences we write a a theta- 
links to $ B when we mean that "the theta-position assigned to o links to 
the tlneta- position assigned to 0* 

We significantly simplify the binding theory |>y representing all arguments 
Of the veih in one order-3 thematic- function. This reform ulation of the 
binding theory does not solve many well-known problems for the standard 
formulation, such as r.bi u- permissibility of J&hn, Ims himsEtfj for fttVtt, ta 
blame lj. 

Let the argument a he assigned the theta-position £[ j) and be governed by 
the C- commanding function f fc (-). Then. COIlditlo-n A requires a link between 
fiU) *"d some fk(m) for [+anaphor] ft. Condition B states that Jy(j} obvi- 
ates all /^(m) for [-anaphor] ft, (Recall that condition B must he stated in 
terms of (-anaphor], rather than the widely assumed [+pian.ornJiaal] 1 in order 
to obtain the IOC effects for pronouns as well as, It-expressions.) When O. Is 
controlled FE.G, then it Is obligatorily theta-linked to its controller, always 
resulting in the covenant interpretation. All such referentially- dependent o 
must be linked or theta-hnked to some fi at S-stru.cm.re, subject to these 
binding conditions. Binding condition C requires thai an 11- expression ob- 
viate- all c-commandlne; phrsua structure positions (in the domain of the 
head of its chain, If strong crossover is reduced to condition C effects £o: 
variables). 

For example, »bviati(/? (l),/g,(a)) holds in example (108-110), and when 
(he aotewdent of hisis Felix, then either N«k(3,l) or link(/ 2& f 1 > ! ./^ (2) ) . We 
leave unanswered the question of whether obviate(/ w ( lJ h /^[2Ji) should be 
included in this list of referential dependencies, as jt seems it shonld be. 

Following Higei] L botriam (1985:573-5). Iinkfct,^) is interpreted to mean in- 
clude some values of .0 En the values of a/ while obviate^, 0) is Interpreted 
to mean 'or and p canuul share any values in the structure in which they 
GMUI. 1 ** 

The necessity of explicitly representing the invariant interpretation usine; 
One (shared) structure prevents us from making Our coreference relation 
entirely between thematic positions, Alternately, the necessity of cxpllc- 

Tlii (Uk9 m4 qaitt wuwk Ibr cm*s fltf split HJitecedeats. irhfin? the verb st-.f.s,^ to hai-e a. 
Eigaiii cani died on wh*(]itt imdilvdii Deviation is ■aafortcd. For ewnplv, (]l]i) ii perfect, 
(nib) anl>- fl|jgh,LLjr degraded, **A (J lie) entLtdy viuonpukte; jet gJJ arc Excluded hi- 
condition B. 
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illy repreflentiug ail corefcrence relations at S-structurej including covariant 
interpretations, prevents; us from making antecedence a Italian entirely 
between phrase structure positions. Therefore, both instance* of the lint 
relation are msnriwi in the theory in order to explicitly represent a per- 
oetvable distinction between invariajit*-COV&Tiant interpretations. The use 
of one linking relation defined an two different types of point* should not 
raise objections Oil the grounds of parsimony when both are necessary, as 
weJ3 as independently motivated. The linking of phrase-structure positions 
is motivated by H i ggi nbnth am (1$83) for anaphoric antecedence, while the 
Linking of thematic- posit ions is motivated by Higginbotham (19&5U9S9) as 
a primitive semantic operation. The mathematician should not find the the 
generalisation of linking to include thematic positions objectionable., be- 
cause it has little effect Oil the computational and generative power of the 
theory, (In fact, it is a straight forward proof that representing ellipsis is in 
the complexity dasaA'P, a theorem thai is nOi so obvious when a copying 
operation is used instead.) 

B.4.3 Ellipsis as a shared t lie niatic-f unction 

An elliptical structure, then, is a proposition P f that contains a thematic 
(unction fi{-) that is not phonolDgicalLy realised. Rather, it is borrowed 
from a proposition P that appears earlier In the discourse^ where /,(-) is the 
result of combining an overt verb with some of its arguments in P. 

The borrowed thematic function must be composed in the same way, as 
shown in {112) for a raising verb, and in (113) for passive. 

a- A man [arrived with his mother) and a woman did [«] too. 
b. * There (arrived a man with his mother] and a woman did [e] 
'.on. 

|LH Ja JuSin suggested LQ Dill; thii fates shoot ibEm^,). 

to. ? Na.v h TK: su^rfltfti to B*Mdictg Xh+1 fate2 pcTiunde iIlcdi^i af la ibjuic 

arnauil pLrapurea 
t, * J«hHi MiggftUcd t« RUL] thii hc f tell ilwm^.jj (a hwc 
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i. A State college [granted Charlie a degree] and a private college 

did [ej too 
b, *■ Chartie [was granted a degree] and a private college did! {e] too 

Accord itig to the principle of full interpretation, a logical const ant is licensed 
only [fit saturates a thematic- position, wLK-rfas a Logical operator is licensed 
only if it binds a logical variable that saturates a thematic-position. Con- 
sequently, a logical variable is licensed only if it both saturates a thematk- 
positicn and is bound by an operator- An elliptical structure is licensed only 
if all overt dements that it contains are licensed. Therefor*, the elements 
ill an elliptical atmcture are subject to two constraints: (i) each logical 
argument (constant or variable) must be assigned a thematic-position fry 
the shared thematic function; (ii) each logical operator with scope over the 
shared thematic function &{-) must bind a thematic-position that is fiee 
id /ifO- The denotational semantics of an elliptical 9-tryeture is given by 
substitution. 

The principle of full interpretation, then, establishes a element- wise bijection 
between some elements in P and some in P* . An dement & £ F and an 
element o/ £ P' are said to ttTrajwnd iff (i) both are logical argument* that 
saturate the same thematic-position /;(;"), for some j; or (ii) hoth are logical 
operators, that bind the same thematic-position //{£), for some fj{k) free in 



Argument correspondence 

Let us now examine, in detail, our representations for the central case of VP- 
ellipsis. VP-eilipsbs results in correspondences between two M arguments, 
and between two external arguments. The example [114 a) of VP-ellipsis 
is assigned the partial representation (ll+b-d). The shared VP thematic 
function J%f) appears in (1 14c). 17 

Rw danly, [ ha** riul repteaentrrf the tli^m-ilit stiaciure of the cooidinaljnj conjunct 
laon. However, Lisrema dt*r thai coacdinaK'tS *re aJshEiMKrciEi fttnciiiHla, from *a*4mnce 
«rf Itl^mitur functions /;{■), . . .. /,(.)■ pf identical iLnjctuit lontw fujicttDii f HI (-), also 
witJi thtMidE HlmctnTf. ThJu, in * Q ye™iit, Lu the intuition utuledy in g "attMB-tbE-lHUld* 
t-OmCiaJeu. 
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■ i. Felix bates blls neighbors and Max does, too. 

b- Mnp l.sahe, 3] [wl% /»(1 ■ ™«)]' /^( 2 : poBseBBion)] 

[NOiidgh&OrS, fm{\ 5 object)), 4] 
e. [vp^voaat*. /? a (L : object)] [ftii nei$hktr$, i], 

i- [[if(«P Fdta, 1] 

[iiIbI-P 351 )! 2] [vpftflie hi* n^Afiors, /J,(l ; «vttlt)], 
/* (3 : actor)], 5] 
[and [[p[NpMix 4 6) 

/"(B Jwtw)],!], 9] 

A perceivable ambiguity arises when & is the external argument of a VP in a 
VFE structure. In this Case h a link gives rise to the Invariant interpretation, 
while * theta-Link yields the covariant interpretation, (In other CaStt, link 
and theta-liak cm both result in an invariant interpretation.) Thus, the 
partial representation in (114) may he completed in one of two ways; 

( L1S 2 oh V iate( /*,( 1 ),/?„ \2 ) \ li nh(3 ? l) 

b. obviatff/^l ),/£,( 2)), Iinkf/Hi{1] JW) 

The link in (WHo) gives the invariant interpretation, while the theta-link in 
(Hob) gives the covajiant interpretation. (Recall thai /sj(1) i* aligned to 
argument 3, the pronoun Jkc) 

Operator correspondence 

We just naw how the outer arpament-s of an rfliptkal structure cm share tike 

thematic function created in a distinct proposition by a verb in combination 
with its Inner arguments. Tin.' pj-- ■-: ■ -'.i ■■ I \\f.tem allows another possibility, 
where an operator with scope over a thematic function shares that thematic 
function with a corresponding operator at LP. That is, if a is an operator 
:Jiat binds a variable c in an overt proposition P r and a' is the corresponding 
operate* with scope over an ellipsed proposition J 3 ', then a' will be inter- 
preted as if it alto binds; the variable e in P- Recall that logical constants 
may become operators as the result of a focusing process. Focus may be 
reliably correlated with Stress, at least in English. 
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This solves the difficulty discussed, above in the context of the Sag- W"i LLiams 
proposal, which is the problematic eases of nonEubject covariance and CP- 
ellipsis. Observe that when tbc corresponding arguments receive parallel 
phcnologicBJ focus 5 then both mty be antecedents of the. tovariant pronoun 
in (ll$a), Hewevei, when only one argument is focused, as in {116b J. or 
when. the focus is applied elsewhere (line), '-lieu the covariant interpretation 
is no longer available. (La fact, (116c) can only mean that "the bursar paid 
the student, 1 ' never "the bursar paid ihc student expenses..*) 

d. The bursar paid the PROFESSOR, [hit] expenses] and the 

STUDENT 3 too. 
b. ? The bursar paid the PROFESSOR* fllJii expenses) and the 

student? too. 
C. *■ The BUR&AR paid the proieasori [flJS] expenses j and the 

EtddeiUa loo. 

divvi i n;5e facta, the explanation of non&u bject cOYariance would seem to 
lie not in reducing nonsubjects. to subject*, but in reducing corresponding 
antecedents to corresponding logical operators. That is, focused elements are 
assigned Scope at LF, and when the corresponding thematic arguments of a 
coordinate structure are focused, then the covarianC interpretation becomes 
possible. The LF representation assigned to the wvariant interpretation of 
{lU3aj would involve proposition-ellipsis and look something like (117)] 

( 11T ) [[[+FOCUS] t'l* professor]; [the bdrsar paid &i hfc £ expenses] t ] and 
[[[+FOCUS] ti*e student], [e]i] 

The examples of CP-el3ipsis would be assigned * similar structure, where the 
focused actor and focused benefactor become logical operators with scope 
over the ghated proposition that Ac tksught she. &&$ dranJt, perhaps as in 
(118) fox the example (76). 

(115) [John,- [Bettft fa told *j [chat *,- th&Ught tj was dmnk] 5 ]|) and 
jOrvltfo [Naomij [e f told e, [t] 3 ]\} too 

The eovariant interpretation of the anaphoric elements in the shared propo- 
sition is enhanced by the "parallelism cue" too, as well as by the equivalence 
between matrix verba, 
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The possibility of operator correspondence resolves an open problem, namely 
line fact that, an anaphoric element may receive a covsuiant interpretation 
even vhen Lis antecedent is not an argument of the shared thematic function, 
provided that the corresponding antecedents art focused, as in (119), or they 
arc inherently logical opera-to-frs, as in (120)- 

(U *i TO Mi [said thai Sue [kissed himi| before BTLL 3 aaked Mary to 

V, TOMi [wanted Sue W |ki99 Jum T ] befoic BILL 2 &*ked Mary to 

[<D- 

([fciM Aim, /a ]) 

^ A Which maiii [said that Sue [kissed hirm] before which boy 2 
asked Mary to [e]r. 
([iiss /n'm^j]) 
b E-verj r-i.ti, Var.ied Su- :c- 'kb* l : n,.j l^r:in' ^iiia! ■a'a 1 , .-j.k<n\ 
Mary to (e]]. 
(ffci» htm-,^}) 

(The relevant interpretation is the One where the adjuncts are understood 
as being, associated with the higher verb, ie r , #ajj/tt"ifl< ^/<jrg,) 

An interesting property of the example (l J 2l) is that a verb with its bene- 
factive argument, Le. s inform M&ry., is in some sense equivalent to a verb 
without any of its internal arguments, it,, $"#■ 

(121) TOMi said [that Sue kissed him!} and BILL Z informed Harry 3 

H 

([that Sue kissed Aun^s/^j]] 

We know on independent grounds that the benefactor does not saturate the 
first argument position of the ¥ttb; rather it is an argument of the verb pJus 
its theme/patient (MarMltZ, 19&0)- That is. the complex predicate analysis 
of double object constructions states that inform, in/orm S, and inform <VP S 
correspond to possible thematic functions, whereas inform jVJ* cannot. The 
covaxiant interpretation of example (121) cannot be accounted for as. theta- 
JiD.lu.Tlg, ^^^n the complex predicate analysis suggested in section B.1.2, but 
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may he accounted for straightforwardly as. operator correspondence Lr. the 
anajysb proposed in this section, 

The central conceptual problem with the proposed sy.stf.-ni is one of pais,i- 
mony. To put things jn the worst possible light, linking can result in an 
invariant interpretation when che antecedent is a togkal constant, Or in a 
covaiiant interpretation when the antecedent is. loglcaf Operator. Likewise. 
theta-linking tan result in a covariant interpretation, 01 an invariant inter- 
pretation when the antecedent is a logical constant outside the domain of the 
shared thematic-function. Thus J t would seem that theta-linLinej is entirety 
unnecessary that we can always account for the tovariant interpretation as 
iiokjite; to a logical Operator. 

BAMncr, this is not the case. What needs to he explained is the complex 
Lnsft-fcCtion among (]} the phonology (stress/unstressed antecedents), (ii) the 
logical type of the antecedent (operator/ argument), (iii) the domain of the 
shared thematic-function (iliclndes/ejccJudes antecedent), and (iv) the in- 
variant and covarjant interpretations- Linking theta-Untong, and argument 
and operator correspondence are ail needed in order to account for the com- 
plex array of facts we have seen so far. "I Tl-o next section presents additional 
evidence. 



B>5 Thn space of elliptical structures 

In this, section, we exercise the proposed system. First, we enumerate the 
empirii id consequence '■>! cur ■.:>■■ is on lo use them .it ii functions n1 i:r,h:-:j. 
Next, we show hew the proposed system accounts for the ciirJiv cases, of 
invisible Crossover, Invisible obvlation, and recursive ellipsis. 

B.5M Possible: domains of ellipsis 

Given eur decision to use thematic functions of order*3, We predict that the 
VO function, the verb-stem function, the V'F function, and. the saturated 
proposition function are the only possible target? for ellipsis. Let us briefly 
consider each in turn. 

True VO-eJIipsis isonlj possible for verba of only one argument, the extern^ 
argument, as. in (122). 
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[l22 i. Bill [left; and John did [e] too 

b. Bltl wanted to [Leave] and John wanted to [el too 

(It Lb of course dimeuEi to distinguish VG- ellipsis from verb stem- or VFr 
ellipsis in these cases.) Oiber e-JtarnpLes of VO elhpsis, such as. (123). aie 
excluded bjf independent principles of the grammar, perhaps the case filter 
applied to internal arguments. 

* 123 i * John [saw] tduy and Bill did [cl Kit* (too). 

b, * John [g*ve] Mary books and Bill did [e] Kate records. 

Gapping structures, as in (1244). cannot involve true VO ellipsis, because 
both the verb and its 10 tense argument are gapped. This means we cannot 
employ a thet a- Linking analysis. Rather, we most follow Pesetsky (1982) in 
iMlyaing gapping as LF argument raising, perhaps by the mechanism of 
focus, combined with proposition-ellipsis, as sketched in (124b^. That is, 
gapping is analyzed a.? the correspondence of logical operators- 

1 al John saw Mary and Hill, Kate. 

b, JJohni [Mary a [*i taw i 3 ] 3 j] and (Billi fKate 2 [e] a ]] 

Verb-stem elhpsis is exemplified in (lSo) lor the verb plus theme/patient. 

(1251 John [donated money] to the Red Cross and Dill did [cj to the 
Hoy Scouts. 

Again, the verb plus directional locative cannot be eLUpsed without violat- 
ing, the case filter- However LF argument raising may he combined with 
proposition ellipsis, as shown in (126) to create the appeaianceof verb-stem 
ellipsis. 

A. John took a bus to New York and Tom, a plane. 

b. [JollJli [a bus? {i| took 1-2 to New York||] and [Torni [a plane j 

m 

The verb plus benefaetive cannot, be eilipsed unless the theme/patient is 
also elEipsed (127). 
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If. * John [donated] mwiej' [to the Red Cross] and Dill did [^ time- 
b, * John [give the Red Cross] money and Bill did (c) time. 

For can the verb plus directional locative be eltipsed unless, the instrument 
is also ellipsed (128). 

(12&) * John [took a plane] to New York and Tom did [e] to Los 
Angeles. 

It is possible, however"-, to ellipse the verb plus henefaelive when the verb 
is p&asivized, raising the theme (12&a), When the 10 morpheme is missing, 
as id (129b)., the utterance must he analyzed as operator correspondence 
combined with proposition ellipsis. 

£ Money wjls [gif^ci (lo) the Had Cross] and time was [e] too. 
h. Mortev 'was given the Rod Cross] and time [«] too. 

Again, the gapping si rue lures in (130) roust be distinguished from true 
ellipsis of the verb plus benefaotive Of verb plus directional locative, which 
are both impossible. 



a. John donated money to the Red Cross and Bill, time. 

b. John took a plane to Mew York and Tom, to L-M Angeles. 

Proposition ellipsis is exemplified by gapping structures, and ':,>■ 1I..7 ..■A,nn- 
ples of uon&ubject covariance, as discussed above in section B.4.3. 



B.-!>/J Invisible crossover 

RecaJJ that H Igginbot ham S (19SSJ theta- binding relation of thematic-discharge 
holds between a determiner and the open theta-position associated with 
□omina]s. Chomsky (1982) suggests that the impossibility of iterating de- 
terminers may bv related to a prohibition against vacuous quantification. 
This motivates HLgglnbotham to equate thcta-binding to the quant i firfttj un 
of theta- positions > in order to block iterated determiners., The theta-Jink 
relation of referential dependency proposed here and Higginbotri am 's theta- 
bJfLdiuE; relation Me Sufficiently similar to suggest that theta- binding reduces 
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to thcta-li flying, perhaps under the stricter locality constraints applying, 
generally to aJl relations of themalic-di*chaige. If this is SO, &* certainly 
B&ems plausible, then our system equates the covariant interpretation of toi 
anaphoric element to the quantification , and ''invisible crossover" 1 effects 
should accrue in VPE. One such example— first noted by D&h! [1072;1O74) 
Mid first explained by Sag (I97arl37) as crossover violation— is ( 13 1 a) t whose 
mill structure has the three interpretations, shown in (l3lb-c). 

a. Billi [believed that tie] loved tiL5 1 wife] and Harry? did [c] too, 

b. {[believed that Aej farad ftrS]/ 2 i"'/0 
t. ([tasimed Jftci he] faved hitj^t vtift]) 

In order Lo obtain interpretation |'l3lb). he must be theta-linked to BiU t 
while Ala may be either linked or theta-Iinked to Bill in thft overt structure, 
resulting in an ambiguity in the null structure However., in order to- obtain 
interpretation (131c), ft* must be tin tad to Bilt'm the overt structure- Now 
in order to obtain the covariant interpretation of his in the null slructrire, 
hi* must be theta-linked to the external argument of the matrix Vf (Bill) 
in the overt structure. But this, is excluded as a crossover configuration in 
the first conjunct of (131a): the theta-position assigned to Bill[ ^quantifies-" 
the theEa-position assigned to /its-], crossing over a pronoun (A*t) that his; 
linked to the argument BilL 

B-.5i3 Invisible obviation 

Invisible obviaiian. structure* ate illustrated in the representation (134) of 
Our previous example (91). The verb want corresponds to a function of one 
internal argument, f}(\ : preposit ion) r ls The shared thematic function 
^(■} appears in (1 34b). 

^T&e bate VP eumplfiin (13?) *u(&«.t lh*t the FP hc*-t*i1 hv *f?/rJr-e sliouLd bv Tie-W 
mt in adjunct lo tbt VP, rather loan as an argument of the Jll event or as th-r inn-rrrrii>:V 
Biruirunt ui tiie V& function, ii lomr hare jujgeited |cf L siren J£fiB, Fa.] J,). 

* [[Run. til mUcnjs before- ]orci]] ix 1rh.1L B.uk1j- did. 

b. [Dd thai,,, .;, after eating hiJirik-Lsjtj it whit Jlcif did. 

c. [Dd tJatjj.j] a. wJi*t Red did iftsr siting brei-l<f**t. 

This b becHiiee Lbe aaLecedeat of the i.haf proacaa. ivJiatever El La, ii not understood 
*J Ln.-clud.ihjg Sh.e FP. Hence Lhe 'hematic function car responding to -be/ire xhpijlci bt 
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£ ttoajL^ti] wanted Rosaline to [l&Y.e IluqI before wanting himself 

to fe] 
h. [vr>{voIove + /£,(! : object)] frjpfcini, 5], 

JS)(] : *V«tt h 2 ; actor)] 
*■ [vpfyQwant., flj(l : proposition.}] 
[n>[}IP Rosaline, ,V 

hliot-^j+to], 4] [vpteto Mm, ^(jfl ; event)], 
J&(2 : actor)], 6], 
/° 6 (1 : »*4itt,2 : actor)] 

d. [xpfm-PRO, 7] 

[]i[]&[-t[is,+ irig] h S) 

[vK.fwfl.wint, /£,(1 : proposition}] 

tp[Hphims*lf. 9\ !ii[in[-tEB,+H ID] [jg,{l ; av«it)j, 
/? (2 : actor V, 11], 
&(] :av*nti;, 
>S,fa = «*«)], 13] 
*■ [ipfrp Romeo., 1] 

bbt-fpwt], a] 

[vp[vpirani tfasaitnfl ffl J<m< ftiifU /f (l : e-Tant)] 

[pp before [ipPRO want+in§ himself to, 12]] 
/f D (l : lt«£)], 
/?„(2 : actor)], 13] 

The associated referential dependencies are: 

**l ohwate(/,Vl)^{Bj), lnki(j^2X&(2)), UnMJM,/"^)) 

b. obviate. /l.dK^aj], linfc t (8,7), finkaC/^),/^)) 

/it(l ; egflnt.3 : mst), ilut in the structure (]«), /, 6 (1) ftth, ET tJieta-mirfu 0* Lhrla- 
id*rvtifi*s j£p{lj, «d /<(,(£) ia (Jneta-ideatLfced with ftrJJ)- Tl\* oajne ugmriMil may br 
appJwd tfl manner adTerbiils, whMi [\iaem dLfficuldEi &n any tliftWjr that luiiyiw th -cm 
as tine inneirir. «t axgumicat af ikr vfrhai fmucju-ii: 

' %, [[Run six milea)] CjuLcldjr], « what Handy did. 

b. [Uo thal ]/ia 3iL»vL.y] Is wliil itad did, 

c. 'Do thnl ]/>2 ] ia *rjia( Rod did jG™|y. 
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Tnc relatkm uf nhvi^tion is between him and RoBotim (the otter obviatlon 
relation, £Dbwiate{/^ > [2) > /f (2)) l between /ktfofrrt* and Jfonttfrt, has he.en sup- 
pressed for dajjty). linlc.! is front the anaphor ^limse!/ to controlled PRO: 
link) is from controlled PRO to Rvrntv. By \hv semantics fli the link id a 
tion, bath arguments B and 7 must include the value of argument 1 in their 
values. By the semantics of the obviate relation, none of arguments assigned 
/»(!) (that is, argument 5) may share a value with any of the arguments 
assigned f^ D [2) (that is, arguments 3 and 4). 

If we enforced conference between hint and fiomco, we would have to add a 
diking relation to ei ther ( 1 35a) or { 1 35b ) , ei ther lin k(o,I ) or lin k{/ a 2 l) ( 1 ),/fo.(2)). 
The effect of adding either link is to include the values of argument 1 in the 
values of argument §; hut then the arguments Q and o share the values of 
argument L which is oxjjres-sly forbid by the pb vr «e! /^(l),/^^)) relation. 

H.5.4 R.E cursive ellipsis 

Tiie last of the tricky cases are the examples -of recursive ellipsis. The 
example (35) from Chapter 4 t reproduced here as (US), has the three possible 
interpretations paraphrased in (137), 

l' I ilr" I 

&- Jack i [[corrected hisi spelling mistakes], before the teacherj did 
[s]i]j and Teda did [e]j too. 

a. Ja<Jti corrected hisi spelling mistakes before the teacher? cor- 
rected his | spelling mistakes and Ted:j corrected hisi spelling 
mistakes hefore the teachers corrected hi&] spelling mistaken 

b. Jack] corrected nisi spewing, mistakes before the Le&chCrz cor- 
rected his 2 spelling mistakes and Te<fa corrected his^ spelling 
mistakes before the teachers corrected hisi spelling mistakes. 

c. Jack] corrected his] spelling mistakes before the teacherj cor- 
rected hisi spelling mistakes and Teda corrected hisj spelling 
mistakes before the teacherj corrected hisj speltmp. mistakes. 

The pit rely invariant and coVariant interpretations (137a.,b respectively) 
piesenL no problems, for the standard ideritity-of-preoifAtLOn. analysis. They 
are analyzed in the current proposal as linking and thet a- linking- The 
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mixed interpretation (137c), which has been considered indomitable evi- 
dence against jdentity-of predication and for a copying operation, is also 
Straightforwardly analyzed in the current proposal as linking with operator 
correspondence between Jackxjt\d T&L, after a.fg(im.ent raising. This analysla 
is connrmed by the fact that both Jock and Ted must, he heavily stressed 
before the interpretation (137c) becomes, available. 



B,6 Conclusion 

The central technical goat of this chapter has been to contribute to the de- 
velopment of a Linguistic theory that is explicit, appropriate, and maximally- 
censtrai ned. 

In order to be appropriate and maximally-constrained, the theory should 
not use a copy operatiuu. One natural consequence of copying a thai the 
original and its- copy are independent with respect to subsequent processes.. 
That is, once the original is copied, a subsequent- pro-cesses will apply to both 
the original and its copy independently. But an we saw, the overt and null 
vpg art not- truly independent in a VPE structure, and therefore the copy 
operation is inappropriate and flhouM be allowed into a restrictive theory 
only as a last resort, 

In order to be explicit, a Linguistic theory must represent all permeable 
linguistic distinctions. As Chomsky (1905:4-5) observes,, "a fully adequate 
grammar must assign to each of an infinite range of sentences a structural 
description indicating how ihia sentence is understood by the ideal speaker- 
hearer> This is the traditional problem of descriptive linguistics. . . .'■ In 
general, distinct interpretations must correspond to distinct linguistic rep- 
resentations. In particular, all referential dependencies. — such as perceived 
coreierence between an anaphor or pronoun and its- linguistic antecedent — 
must be represented by an explicit syntactic relation of corefcrcnce* even if 
the binding conditions are Stated in terms of obviation. To do otherwise wii] 
result in a less than adequate theory, 
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